-- Logs begin at Thu 2022-07-28 05:21:45 UTC, end at Thu 2022-07-28 06:47:50 UTC. -- Jul 28 06:19:10.468722 dv-cinder-812429-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 06:19:10.479872 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 06:19:10 2022] *** Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: nodename: dv-cinder-812429-2-iscsi Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: machine: x86_64 Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: clock source: unix Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: pcre jit disabled Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: detected number of CPU cores: 4 Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: current working directory: / Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: detected binary path: /usr/bin/uwsgi-core Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: your processes number limit is 47680 Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: your memory page size is 4096 bytes Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: detected max file descriptor number: 2048 Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: lock engine: pthread robust mutexes Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: thunder lock: enabled Jul 28 06:19:10.480673 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 06:19:10.481882 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 06:19:10.520716 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: Python main interpreter initialized at 0x55f32c8e19c0 Jul 28 06:19:10.520716 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: python threads support enabled Jul 28 06:19:10.520716 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: your server socket listen backlog is limited to 100 connections Jul 28 06:19:10.520716 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: your mercy for graceful operations on workers is 90 seconds Jul 28 06:19:10.521100 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 06:19:10.521100 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: *** Operational MODE: preforking *** Jul 28 06:19:10.521401 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: *** uWSGI is running in multiple interpreter mode *** Jul 28 06:19:10.521401 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: spawned uWSGI master process (pid: 103576) Jul 28 06:19:10.521600 dv-cinder-812429-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 06:19:10.522511 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: spawned uWSGI worker 1 (pid: 103577, cores: 1) Jul 28 06:19:10.522511 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: spawned uWSGI worker 2 (pid: 103578, cores: 1) Jul 28 06:19:10.522820 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 06:19:11.188030 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:19:11.191538 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:19:12.287800 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:19:12.287800 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: from cryptography.utils import int_from_bytes Jul 28 06:19:12.288440 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:19:12.288440 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: from cryptography.utils import int_from_bytes Jul 28 06:19:12.288627 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:19:12.288627 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: from cryptography.utils import int_from_bytes Jul 28 06:19:12.289047 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:19:12.289047 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: from cryptography.utils import int_from_bytes Jul 28 06:19:14.815506 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:19:14.816689 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:19:14.816835 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:19:14.817191 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:19:14.817473 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:19:14.817856 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.818178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.818492 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.818804 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.819122 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.819424 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.819735 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.820046 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.820460 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.820624 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.820930 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.821243 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812429-2-iscsi {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.821582 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.821882 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.822187 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.822500 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.822798 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.823112 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.823411 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.823900 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.824352 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.824655 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.824963 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.825291 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.825622 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.825925 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.826240 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.826541 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.826856 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.827160 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.827557 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812429-2-iscsi {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.827867 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.828175 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.828479 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.828880 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.829183 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.829509 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.829823 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.830139 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.830447 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.830763 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.831074 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.831385 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.832313 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.832635 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.832910 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.833212 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.833548 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.833847 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.834147 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.834391 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.834690 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.835004 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.835316 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.835631 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.835878 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.836123 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.836433 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.836983 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.836983 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.837450 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.837639 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.837938 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.838241 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.838540 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.838838 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.839136 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.839449 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.839756 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.840070 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.840375 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.840687 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.841074 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.841354 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.841645 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.841977 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.842290 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.842591 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.842903 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.843215 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.843519 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.843817 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.844316 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.844500 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:19:14.845008 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.845095 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:19:14.845182 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.845182 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.845369 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:19:14.845465 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.845648 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:19:14.845749 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.845903 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:19:14.846038 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.846275 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.846360 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.846575 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.846674 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.846875 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.846970 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.847215 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.847303 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.847538 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.847625 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.847857 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.847952 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.848175 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.848271 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.848484 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.848572 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.848786 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.848871 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.849049 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.849145 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.849387 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.849492 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.849712 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812429-2-iscsi {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.849802 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850031 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850127 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850333 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850420 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850640 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850728 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.850951 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851044 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851248 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851334 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851566 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851651 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851877 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.851975 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.852192 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.852375 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.852504 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.852682 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.852806 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.852983 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.853106 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.853288 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.853447 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.853641 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.853730 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.853950 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.854037 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.854255 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.854341 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.854572 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.854660 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.854880 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855022 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855189 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855283 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855484 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855572 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855786 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.855879 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812429-2-iscsi {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.856095 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.856240 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.856446 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.856555 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.856751 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.856847 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857055 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857164 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857368 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857501 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857669 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857810 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.857968 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.858133 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.858278 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.858464 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.858554 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.858738 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.858826 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.859060 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.859156 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.859381 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.859500 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.859702 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.859859 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860003 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860116 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860297 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860392 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860604 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860702 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.860916 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.861032 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.861222 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.861342 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.861551 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.861645 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.861850 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.861952 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.862100 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.862263 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.862403 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.862589 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.862753 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.862949 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.863101 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.863244 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.863393 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.863548 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.863685 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.863846 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.864023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.864155 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.864241 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.864461 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.864556 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.864762 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.864849 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.865065 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.865158 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.865390 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.865494 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.865696 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.865784 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.865999 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.866084 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.866301 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.866386 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.866606 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.866702 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.866906 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.866994 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.867216 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.867323 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.867522 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.867609 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.867837 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.867922 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.868178 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.868278 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.868492 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.868741 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.868828 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.869167 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.869362 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.869466 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.869672 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.869760 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.870008 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.870120 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.870340 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.870626 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.870716 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.870990 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.871096 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.871240 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.871329 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.871543 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.871636 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.871846 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.871933 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.872148 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.872249 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.872476 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.872590 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.872764 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.872851 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.873070 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.873165 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.873370 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.873463 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.873635 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.873733 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.873937 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.874032 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.874275 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.874385 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.874551 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.874647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.874855 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.874961 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.875157 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.875246 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.875455 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.875542 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.875756 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.875857 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.876056 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.876141 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.876354 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.876446 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.876651 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.876745 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.876951 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.877039 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.877249 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.877353 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.877578 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.877675 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.877874 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.877960 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.878173 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.878266 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.879085 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.879173 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.879395 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.879529 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.879728 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.879847 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.880034 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.880154 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.880343 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.880447 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.880651 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.880747 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.880962 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.881058 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.881265 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.881444 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.881597 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.881753 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.881904 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.882075 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.882207 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.882380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.882526 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.882683 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.882832 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.883000 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.883131 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.883304 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.883449 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.883607 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.883751 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.883921 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.884050 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.884221 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.884343 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.884525 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.884649 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.884841 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.884957 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.885145 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.885262 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.885472 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.885595 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.885774 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.885913 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.886077 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.886221 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.886384 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.886528 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.886685 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.886839 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.886972 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.887167 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.887266 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.887467 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.887554 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.887787 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.887881 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.888105 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.888218 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.888417 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.888513 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.888715 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.888802 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.889020 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.889109 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.889331 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.889421 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:19:14.889636 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.889734 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.889936 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890025 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890240 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890326 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890538 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890632 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890844 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.890938 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.891142 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.891233 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.891440 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.891534 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.891738 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.891826 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892055 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892151 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892361 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892459 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892659 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892753 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.892957 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.893044 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.893254 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.893369 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.893621 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.893708 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.894027 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.894652 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.894881 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.894978 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.895219 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.895318 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.895531 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.895618 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.895852 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.895948 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.896160 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.896247 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.896471 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.896565 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.896779 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.896868 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.897086 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.897172 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.897417 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.897509 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.897725 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.897813 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898039 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898173 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898345 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898434 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898657 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898746 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.898963 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899060 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899279 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899369 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899584 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899674 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899892 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.899978 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.900189 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.900287 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.900498 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.900585 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.900822 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.900908 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.901137 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.901234 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.901472 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.901561 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.901784 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.901874 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902088 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902193 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902393 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902486 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902693 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902779 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.902997 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.903092 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.903302 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.903389 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.903608 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.903695 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.903914 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904002 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904217 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904307 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904523 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904616 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904853 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.904942 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.905122 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.905210 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.905479 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.905563 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.905743 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.905838 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.906037 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.906124 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.906342 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.906429 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.906650 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.906787 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907005 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907113 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907270 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907358 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907575 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907664 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907890 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.907976 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.908191 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.908287 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.908491 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.908579 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.908797 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.908882 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.909092 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.909194 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.909414 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.909542 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.909751 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.909895 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910054 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910155 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910358 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910452 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910661 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910748 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.910967 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911068 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911267 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911354 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911566 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911652 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911867 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.911963 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.912167 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.912261 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.912501 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.912604 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.912778 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.912866 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.913080 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.913173 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.913447 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.913563 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.913753 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.913843 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914073 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914160 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914370 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914463 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914678 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914767 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.914979 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915075 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915280 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915447 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915580 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915667 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915878 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.915965 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.916216 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.916311 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.916524 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.916625 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.916822 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.916977 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.917131 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.917227 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.917457 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.917559 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.917761 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.917850 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918159 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918368 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918454 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918665 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918751 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.918970 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919059 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919271 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919413 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919571 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919659 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919872 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.919961 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.920173 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.920266 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.920480 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.920567 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.920776 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.920870 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.921078 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.921165 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.921405 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.921497 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.921712 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.921807 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922017 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922118 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922319 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922421 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922622 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922709 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.922935 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.923022 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.923276 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.923502 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.923591 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.923829 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.923915 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.924139 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.924235 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.924451 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.924543 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.924759 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.924846 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.925065 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.925677 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.925931 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.926029 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.926279 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.926515 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.926602 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.926864 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927010 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927170 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927259 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927481 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927567 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927784 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.927873 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928086 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928171 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928392 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928493 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928694 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928789 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.928995 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.929089 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.929294 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.929437 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.929623 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.929720 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.929924 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930017 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930226 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930527 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930626 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930864 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.930950 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.931172 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.931261 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.931476 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.931570 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.931784 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.931870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932086 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932173 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932397 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932483 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932699 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932784 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.932998 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.933084 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.933295 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.933405 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.933614 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.933700 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.933918 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934062 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934230 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934319 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934557 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934645 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934879 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.934964 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.935216 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.935305 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.935517 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.935603 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.935818 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.935917 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.936136 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.936222 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.936434 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.936527 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.936734 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.936834 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937034 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937121 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937357 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937448 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937661 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937763 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.937958 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938045 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938262 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938355 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938567 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938661 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.938958 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.939170 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.939255 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.939467 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.939602 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.939768 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.939856 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.940062 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.940147 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.940368 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.940461 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.940670 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.940762 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.941611 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.941786 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.941935 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.942095 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.942256 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.942404 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.942559 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.942709 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.942870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943170 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943316 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943477 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943616 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.943928 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.944107 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.944228 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.944386 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.944527 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.944725 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.944815 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945033 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945217 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945356 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945557 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945674 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945858 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.945993 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.946179 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.946301 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.946485 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.946614 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.946787 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.946924 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.947087 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.947232 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.947391 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.947592 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.947738 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.947906 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948056 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948215 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948334 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948524 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948674 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948833 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.948950 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.949141 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.949258 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.949471 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.949563 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.949792 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.949887 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.950098 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.950195 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.950407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.950497 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.950707 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.950818 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951007 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951096 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951307 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951426 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951610 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951707 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.951914 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.952173 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.952263 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.952512 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.952658 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.952812 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.952924 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.953112 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.953200 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.953439 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.953547 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.953734 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.953823 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.954071 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.954158 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.954372 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.954467 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.954717 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.954813 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955017 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955111 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955325 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955420 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955631 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955739 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.955931 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956042 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956237 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956327 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956575 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956666 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956882 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.956975 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.957184 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.957351 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.957524 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.957650 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.957892 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.957989 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.958194 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.958296 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.958495 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.958583 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.958799 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.958885 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.959105 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.959216 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.959406 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.959495 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.959717 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.959859 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960123 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960336 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960423 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960637 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960724 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.960937 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961032 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961239 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961379 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961568 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961668 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961878 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.961979 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.962183 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.962270 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.962488 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.962574 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.962795 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.962892 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.963102 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.963196 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.963409 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.963496 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.963714 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.963802 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964015 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964102 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964319 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964406 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964618 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964705 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.964917 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965003 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965249 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965398 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965580 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965676 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965879 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.965972 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.966183 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.966270 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.966481 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.966569 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.966783 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.966870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.967082 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.967183 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.967385 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.967506 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.967702 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.967810 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968007 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968292 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968599 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968692 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968905 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.968991 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.969208 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.969298 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.969541 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.969638 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.969849 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.969935 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.970149 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.970238 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.970458 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.970546 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.970762 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.970859 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971076 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971165 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971379 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971468 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971684 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971780 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.971987 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.972094 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.972320 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.972408 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.972627 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.972723 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.972928 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973228 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973335 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973555 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973652 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973856 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.973949 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.974159 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.974303 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.974464 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.974552 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.974766 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.974938 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.975067 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.975247 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.975375 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.975547 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.975693 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.975959 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976045 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976296 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976442 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976600 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976686 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976900 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.976978 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.977206 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.977293 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.977536 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.977616 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.977837 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.977912 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.978136 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.978214 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.978438 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.978515 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.978742 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.978830 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979044 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979139 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979346 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979434 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979652 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979746 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.979952 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980088 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980250 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980337 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980552 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980639 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980852 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.980942 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.981168 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.981254 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.981505 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.981605 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.981861 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.981996 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.982165 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.982258 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.982477 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.982576 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.982794 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.982882 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.983096 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.983184 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.983398 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.983497 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.983704 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.983798 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984003 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984089 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984305 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984401 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984609 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984696 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984913 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.984998 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.985211 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.985299 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.985538 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.985673 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.985838 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.985923 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.986142 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.986230 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.986443 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.986529 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.986758 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.986883 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.987056 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.987143 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.987375 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.987472 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.988211 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.988308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.988570 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.988714 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.988876 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.988970 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.989184 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.989286 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.989518 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.989616 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.989827 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.989915 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.990140 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.990247 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.990449 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.990538 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.990754 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.990849 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991060 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991159 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991371 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991459 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991678 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991792 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.991985 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.992075 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.992294 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.992391 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.992597 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.992686 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.992919 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.993026 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.993229 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.993350 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.993556 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.993657 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.994110 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.994205 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.994439 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.994527 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.994742 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.994829 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995043 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995130 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995349 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995490 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995650 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995786 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.995950 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.996095 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.996249 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.996401 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.996552 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.996708 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.996849 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997016 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997148 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997345 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997474 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997660 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997791 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.997963 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.998091 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.998383 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.998480 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.998695 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.998790 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.998995 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.999084 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.999313 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.999415 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.999615 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.999708 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:14.999935 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000025 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000236 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000324 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000556 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000649 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000862 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.000952 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.001166 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.001263 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.001494 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.001595 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.001805 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.001900 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.002106 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.002193 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.002417 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.002514 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.002728 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.002823 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.003094 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.003181 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.003995 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.004114 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.004407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.004505 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.004739 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.004865 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.005049 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.005181 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.005394 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.005524 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.005716 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.005846 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.006038 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.006144 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.006343 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.006439 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.006655 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.006964 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.007067 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.007284 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.007373 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.007596 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.007683 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.007904 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008000 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008212 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008307 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008512 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008599 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008820 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.008915 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.009131 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.009228 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.009465 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.009554 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.009782 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.009872 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.010091 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.010180 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.010417 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.010505 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.010735 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.010847 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.011056 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.011177 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.011390 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.011501 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.011703 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.011792 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012021 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012109 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012332 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012428 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012640 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012728 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.012962 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.013056 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.013285 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.013401 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.013611 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.013705 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.013917 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014005 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014224 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014324 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014529 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014617 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014833 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.014927 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.015132 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.015220 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.015436 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.015522 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.015743 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.015830 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.016046 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.016137 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.016361 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.016450 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.016693 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.016780 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017000 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017127 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017354 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017458 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017650 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017739 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.017958 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018049 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018263 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018349 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018565 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018660 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.018988 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.019235 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.019475 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.019566 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.019790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.019886 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.020119 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.020207 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.020441 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.020761 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.020854 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.021072 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.021160 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.021412 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.021522 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.021731 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.021826 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022035 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022123 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022338 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022434 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022645 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022733 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.022944 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023032 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023240 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023335 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023543 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023630 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023845 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.023933 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.024139 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.024305 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.024443 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.024531 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.024744 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.024833 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.025046 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.025267 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.025400 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.025634 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.025722 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.025946 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026088 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026265 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026353 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026567 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026661 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.026968 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.027168 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.027255 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.027466 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.027560 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.027773 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.027867 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028072 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028160 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028381 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028469 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028690 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028778 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.028990 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.029077 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.029290 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.029448 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.029620 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.029714 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.029924 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030020 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030223 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030310 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030526 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030616 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030825 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.030912 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.031146 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.031242 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.031446 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.031541 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.031752 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.031840 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032054 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032159 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032357 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032484 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032655 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032751 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.032954 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.033059 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.033254 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.033392 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.033577 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.033825 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.033923 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.034157 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.034251 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.034457 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.034562 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.034809 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.034897 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.035116 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.035287 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.035415 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.035611 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.035719 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.035928 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.036067 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.036243 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.036382 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.036554 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.036683 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.036865 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037005 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037180 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037321 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037535 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037625 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037859 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.037949 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.038189 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.038276 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.038495 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.038590 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.038824 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.038919 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.039134 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.039222 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.039450 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.039663 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.039754 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.039995 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.040082 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.040314 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.040414 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.040646 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.040735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.040975 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.041063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.041280 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.041452 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.041606 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.041704 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.041913 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042001 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042219 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042320 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042530 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042618 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042836 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.042930 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.043140 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.043240 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.043445 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.043534 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.043749 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.043837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044056 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044190 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044358 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044444 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044664 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044758 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.044969 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.045057 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.045274 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.045409 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.045603 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.045689 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.045907 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.046003 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.046323 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.046417 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.046636 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.046732 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.046948 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.047042 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.047286 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.047375 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.047604 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.047700 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.047921 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048008 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048234 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048321 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048548 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048644 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048853 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.048940 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.049157 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.049245 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.049488 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.049592 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.049796 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.049883 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.050101 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.050700 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.050948 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.051136 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.051261 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.051469 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.051697 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.051785 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.052091 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.052180 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.052405 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.052494 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.052720 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.052938 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.053035 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.053284 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.053438 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.053625 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.053726 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.053952 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054087 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054260 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054356 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054577 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054665 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054881 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.054969 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.055203 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.055290 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.055506 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.055599 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.055810 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.055906 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.056125 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.056213 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.056437 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.056527 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.056735 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.056824 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057035 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057125 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057361 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057466 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057668 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057756 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.057971 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058066 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058268 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058363 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058567 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058655 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058871 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.058959 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.059169 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.059266 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.059469 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.059562 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.059769 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.059863 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060066 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060164 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060367 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060489 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060664 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060752 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.060963 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061259 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061359 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061582 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061686 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061880 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.061969 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.062183 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.062271 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.062484 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.062572 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.062779 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.062867 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063079 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063167 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063374 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063462 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063671 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063759 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.063967 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064054 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064292 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064388 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064605 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064694 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064912 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.064998 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.065218 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.065362 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.065592 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.065693 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.066463 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.066599 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.066757 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.067192 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.067337 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.067519 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.067676 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.067843 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.068159 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.068472 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.068559 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.068804 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.069014 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.069110 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.069441 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.069533 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.069751 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.070040 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.070136 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.070357 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.070545 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.070664 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.070987 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.071075 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.071321 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.071522 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.071621 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.071918 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.072014 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.072231 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.072484 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.072582 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.072846 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.072933 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.073171 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.073447 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.073551 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.073801 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.073932 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.074106 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.074412 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.074500 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.074718 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.074884 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.075020 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.075328 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.075414 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.075633 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.075820 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.075938 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.076248 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.076335 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.076559 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.076752 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.076875 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.077194 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.077281 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.077525 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.077710 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.077845 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.078166 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.078254 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.078509 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.078643 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.078814 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.079117 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.079217 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.079457 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.079599 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.079765 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.080071 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.080166 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.080372 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.080592 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.080680 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:19:15.081079 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.081626 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.082115 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.082590 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.083103 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.083662 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.084206 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.084777 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.085385 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.085948 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.086478 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.087225 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.087792 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.088373 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.088939 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.089522 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.090095 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.090548 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.090868 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.091196 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.091514 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.091849 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.092194 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.092526 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.092852 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.093162 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.093499 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.093807 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.094119 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.094441 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.094754 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.095059 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.095364 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.095673 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.095977 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.096284 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.096587 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.096890 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.097391 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.097819 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.098206 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.098661 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.099109 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.099629 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.100023 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.100343 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.100653 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.100962 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.101269 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.101600 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.101908 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.102244 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.102575 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.102893 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.104005 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.104005 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.104005 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.104260 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.104428 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.104746 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.105058 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.105393 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.105725 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.106037 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.106343 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.106652 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.106960 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.107275 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.107586 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.107912 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.108235 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.108545 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.108865 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.109835 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.109835 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.109835 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.110116 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.110442 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.110748 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.111055 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.111361 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.111668 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.111975 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.112287 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.112593 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.113461 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.113779 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.114084 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.114411 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.114809 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.115320 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.115821 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.116233 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.116713 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.117263 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.117652 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.118243 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.118654 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.119233 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.119542 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:19:15.119789 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:19:15.237446 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO dbcounter [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Registered counter for database nova_api Jul 28 06:19:15.261626 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_db.sqlalchemy.engines [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.268587 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writer thread running {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.293223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO dbcounter [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Registered counter for database nova_api Jul 28 06:19:15.313093 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_db.sqlalchemy.engines [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.320358 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writer thread running {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.325082 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.context [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb(cell1) {{(pid=103577) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:19:15.329070 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:19:15.330678 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:19:15.332026 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:19:15.334083 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:19:15.336038 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO dbcounter [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Registered counter for database nova_cell0 Jul 28 06:19:15.341443 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO dbcounter [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Registered counter for database nova_cell1 Jul 28 06:19:15.350787 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_db.sqlalchemy.engines [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.351408 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_db.sqlalchemy.engines [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.359097 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writer thread running {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.359425 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writer thread running {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.377298 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.context [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb(cell1) {{(pid=103578) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:19:15.381875 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_concurrency.lockutils [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:19:15.383458 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_concurrency.lockutils [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:19:15.384248 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_concurrency.lockutils [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:19:15.386266 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_concurrency.lockutils [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103578) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:19:15.388329 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO dbcounter [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Registered counter for database nova_cell0 Jul 28 06:19:15.394776 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO dbcounter [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Registered counter for database nova_cell1 Jul 28 06:19:15.402535 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_db.sqlalchemy.engines [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.404433 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_db.sqlalchemy.engines [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.410178 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writer thread running {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.412956 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writer thread running {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.510376 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO dbcounter [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Registered counter for database nova_cell0 Jul 28 06:19:15.520555 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_db.sqlalchemy.engines [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.526537 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writer thread running {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.565392 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO dbcounter [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Registered counter for database nova_cell0 Jul 28 06:19:15.574865 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG oslo_db.sqlalchemy.engines [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:19:15.579604 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writer thread running {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:19:15.938195 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: WARNING keystonemiddleware.auth_token [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:19:15.946341 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: WARNING keystonemiddleware.auth_token [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:19:15.981760 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: WARNING keystonemiddleware.auth_token [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:19:15.989639 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: WARNING keystonemiddleware.auth_token [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:19:16.286128 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: WARNING keystonemiddleware.auth_token [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:19:16.292301 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: WARNING keystonemiddleware.auth_token [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:19:16.297778 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f32c8e19c0 pid: 103577 (default app) Jul 28 06:19:16.299866 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:19:16.301429 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001916 Jul 28 06:19:16.301845 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Thu Jul 28 06:19:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:19:16.332961 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: WARNING keystonemiddleware.auth_token [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:19:16.339003 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: WARNING keystonemiddleware.auth_token [None req-2427b8a1-8ad1-4b6e-be02-b842b65797ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:19:16.344309 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f32c8e19c0 pid: 103578 (default app) Jul 28 06:20:35.948292 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:35.949282 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 28 06:20:35.949704 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:35.962871 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writing DB stats nova_api:SELECT=3 {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.963744 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writing DB stats nova_cell0:SELECT=3 {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.964456 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writing DB stats nova_cell1:SELECT=3 {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:35.965646 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:36.860887 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-11df935e-fa9e-4c92-96a3-0a7c40569dfb admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:36.892429 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-11df935e-fa9e-4c92-96a3-0a7c40569dfb admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935049 Jul 28 06:20:36.893174 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 28 06:20:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:39.131811 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:39.132662 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-e024b700-e65c-4025-8ca6-bef5324cfb2e None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003658 Jul 28 06:20:39.133443 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:39.632891 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-5f165d77-8e3e-46bc-84ea-0f438eada346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:39.652997 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:20:39.652997 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: warnings.warn(msg) Jul 28 06:20:39.713985 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-5f165d77-8e3e-46bc-84ea-0f438eada346 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.573056 Jul 28 06:20:39.714818 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:20:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:39.728325 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_api:SELECT=3 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:39.729297 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_cell1:SELECT=3 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:39.730428 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_cell0:SELECT=3 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:39.731189 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:20:39.934975 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-7ed6f257-e785-4289-ade2-2477be009acc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:39.939844 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:20:39.939844 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: warnings.warn(msg) Jul 28 06:20:40.092580 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-7ed6f257-e785-4289-ade2-2477be009acc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369408 Jul 28 06:20:40.105620 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 28 06:20:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:42.371185 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-5f165d77-8e3e-46bc-84ea-0f438eada346 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:42.372436 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-5f165d77-8e3e-46bc-84ea-0f438eada346 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 28 06:20:42.372831 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:43.043420 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-56462fc6-1d8e-424a-867b-1fbbcaab396f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:43.064828 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:20:43.064828 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: warnings.warn(msg) Jul 28 06:20:43.182398 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-56462fc6-1d8e-424a-867b-1fbbcaab396f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.802833 Jul 28 06:20:43.183074 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:20:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:43.195082 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f541d085-661a-4380-8449-b20926048802 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:43.198533 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:20:43.198533 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: warnings.warn(msg) Jul 28 06:20:43.297087 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-f541d085-661a-4380-8449-b20926048802 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105549 Jul 28 06:20:43.307470 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 28 06:20:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:45.594450 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-56462fc6-1d8e-424a-867b-1fbbcaab396f admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:45.595465 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-56462fc6-1d8e-424a-867b-1fbbcaab396f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 28 06:20:45.595868 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:46.027296 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-775a5a28-b845-4b07-b9f1-3327e53aca26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:46.106083 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-775a5a28-b845-4b07-b9f1-3327e53aca26 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504252 Jul 28 06:20:46.107024 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:20:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:20:46.119974 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-4a96ff84-f9d0-427f-a142-16075ce2ac1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:46.208578 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-4a96ff84-f9d0-427f-a142-16075ce2ac1c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092367 Jul 28 06:20:46.209221 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 28 06:20:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:48.490844 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-775a5a28-b845-4b07-b9f1-3327e53aca26 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:48.490844 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-775a5a28-b845-4b07-b9f1-3327e53aca26 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 28 06:20:48.490844 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:48.979787 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-d6224216-0b68-45f6-9b3f-e524b675c4cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "vcpus": 2, "swap": 0}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:49.063886 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-d6224216-0b68-45f6-9b3f-e524b675c4cf admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.567794 Jul 28 06:20:49.064606 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:20:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:49.076348 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-e16fa964-ba16-467a-aa68-68f2ddeebf71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:49.164434 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-e16fa964-ba16-467a-aa68-68f2ddeebf71 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091767 Jul 28 06:20:49.165006 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 28 06:20:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:51.386563 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-d6224216-0b68-45f6-9b3f-e524b675c4cf admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:51.387557 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-d6224216-0b68-45f6-9b3f-e524b675c4cf admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 28 06:20:51.387957 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:51.854167 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-eb8c3b78-be62-457b-95d7-45ead7a85198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "ram": 4096, "name": "ds4G"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:51.976329 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-eb8c3b78-be62-457b-95d7-45ead7a85198 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581485 Jul 28 06:20:51.977280 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:20:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:20:51.989710 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-585e9838-8e56-4744-846d-54e68d892cc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:52.114058 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-585e9838-8e56-4744-846d-54e68d892cc3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128154 Jul 28 06:20:52.114868 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 28 06:20:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:20:54.342089 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-eb8c3b78-be62-457b-95d7-45ead7a85198 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:54.343404 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-eb8c3b78-be62-457b-95d7-45ead7a85198 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Jul 28 06:20:54.343921 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:54.797500 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-ecd70886-4bcc-4156-858f-89c399a044d2 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:54.822531 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-ecd70886-4bcc-4156-858f-89c399a044d2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.472164 Jul 28 06:20:54.823091 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 28 06:20:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:20:57.463166 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-eb8c3b78-be62-457b-95d7-45ead7a85198 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:20:57.464147 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-eb8c3b78-be62-457b-95d7-45ead7a85198 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 28 06:20:57.464593 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:20:57.945930 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-679651c5-3b42-4d83-a59a-1259ad2934c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "disk": 1}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:58.029034 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-679651c5-3b42-4d83-a59a-1259ad2934c7 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.557984 Jul 28 06:20:58.029635 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:20:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:20:58.041752 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-db866f71-037d-4e2b-bbee-8c6717159289 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:20:58.126915 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-db866f71-037d-4e2b-bbee-8c6717159289 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088765 Jul 28 06:20:58.127691 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 28 06:20:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:21:00.368271 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-679651c5-3b42-4d83-a59a-1259ad2934c7 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:00.369287 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-679651c5-3b42-4d83-a59a-1259ad2934c7 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 28 06:21:00.369713 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:00.782705 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-1a8a917d-679a-4365-9712-1ef4bdabea0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:00.867719 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-1a8a917d-679a-4365-9712-1ef4bdabea0e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491403 Jul 28 06:21:00.868274 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:21:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:00.880611 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-00f0936e-e8b9-4250-a7dd-a2359dedde21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:00.974333 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-00f0936e-e8b9-4250-a7dd-a2359dedde21 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097617 Jul 28 06:21:00.974898 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 28 06:21:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:21:03.210804 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-1a8a917d-679a-4365-9712-1ef4bdabea0e admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:03.211838 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-1a8a917d-679a-4365-9712-1ef4bdabea0e admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 28 06:21:03.212241 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:21:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:03.577024 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-346504d2-b828-4c9a-95a6-1e2a871a9851 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:03.662467 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-346504d2-b828-4c9a-95a6-1e2a871a9851 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.443906 Jul 28 06:21:03.666438 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:21:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:21:03.675040 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-35572321-70ee-4c5d-8963-00bd8568cde8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:03.767944 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-35572321-70ee-4c5d-8963-00bd8568cde8 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096574 Jul 28 06:21:03.781964 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 28 06:21:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:21:06.064810 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-346504d2-b828-4c9a-95a6-1e2a871a9851 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:06.065854 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-346504d2-b828-4c9a-95a6-1e2a871a9851 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 28 06:21:06.066515 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:21:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:21:06.567840 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-5a951633-92d9-403d-b762-bcacdb72ba5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:06.574247 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:06.667388 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-5a951633-92d9-403d-b762-bcacdb72ba5c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.594816 Jul 28 06:21:06.677332 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:21:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:06.682523 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-bbc3e16c-f899-49de-a4c7-4a66482cd776 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:06.810974 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-bbc3e16c-f899-49de-a4c7-4a66482cd776 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131886 Jul 28 06:21:06.811505 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 28 06:21:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:21:09.301179 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-5a951633-92d9-403d-b762-bcacdb72ba5c admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:09.302232 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-5a951633-92d9-403d-b762-bcacdb72ba5c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 28 06:21:09.302798 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:09.815918 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-6f83cfce-9f88-4ad6-a72a-396c49a0437b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:10.313207 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-6f83cfce-9f88-4ad6-a72a-396c49a0437b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.003944 Jul 28 06:21:10.314005 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 28 06:21:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:10.326750 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-44a92353-115e-4660-84de-a593526fdf3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:10.432972 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-44a92353-115e-4660-84de-a593526fdf3a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110039 Jul 28 06:21:10.448319 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 28 06:21:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:21:29.857495 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-6f83cfce-9f88-4ad6-a72a-396c49a0437b admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:29.858510 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-6f83cfce-9f88-4ad6-a72a-396c49a0437b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 28 06:21:29.858919 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:30.254665 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f406e9ba-d58e-45c8-9ed8-215c86553d8e admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:30.273713 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-f406e9ba-d58e-45c8-9ed8-215c86553d8e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.408308 Jul 28 06:21:30.274186 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 28 06:21:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:21:31.352594 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-6f83cfce-9f88-4ad6-a72a-396c49a0437b admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:31.353641 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-6f83cfce-9f88-4ad6-a72a-396c49a0437b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 28 06:21:31.354051 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:31.898621 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-e282f0f9-04f0-4ccf-a6f1-98ca26cbb783 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:31.904502 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.wsgi [None req-e282f0f9-04f0-4ccf-a6f1-98ca26cbb783 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-e282f0f9-04f0-4ccf-a6f1-98ca26cbb783 admin admin] Request method failure captured: Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Accept: application/json Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Accept-Encoding: gzip, deflate Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Connection: keep-alive Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Content-Length: 0 Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Host: 10.222.0.69 Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Openstack-Api-Version: compute 2.90 Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Openstack-System-Scope: None Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: User-Agent: python-novaclient Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Auth-Token: gAAAAABi4irrTVCPu4LwPlmMBDSPxYXWazUp1_t3UlnKSlrGbfpYF5wiKlIqGIDWizDRHgO458qTLXjn2T3EZnAiqWhqHVbaHWRk41Fghy3F48VQqa97iQsOMsJQuNTn-cKmUl4rBnBJgCzkIo4BfRKaT1Khi4KXKaTxMVfCxizuxAVt-nGS_SE Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Domain-Id: None Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Domain-Name: None Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Identity-Status: Confirmed Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Is-Admin-Project: True Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Domain-Id: default Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Domain-Name: Default Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Name: admin Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Role: admin,reader,member Jul 28 06:21:31.907837 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Roles: admin,reader,member Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05bb534ab3954f32aad6d8b3751d3ac9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}] Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant: admin Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant-Name: admin Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User: admin Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Domain-Id: default Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Domain-Name: Default Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Id: b42a77304cdd4ceda1f777fdc9b5ccf9 Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Name: admin Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: method: > Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: exception: Flavor 42 could not be found. Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: action_args: {'id': '42'} Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:21:31.909735 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:31.910781 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:31.912223 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-e282f0f9-04f0-4ccf-a6f1-98ca26cbb783 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:21:31.913736 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-e282f0f9-04f0-4ccf-a6f1-98ca26cbb783 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.414850 Jul 28 06:21:31.913736 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 28 06:21:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 06:21:31.919068 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-9b69db8c-58ae-46ed-9c31-7b5ef30805fb admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:31.923643 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:21:31.942931 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-9b69db8c-58ae-46ed-9c31-7b5ef30805fb admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027370 Jul 28 06:21:31.946875 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 28 06:21:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:21:31.954213 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-54dd3217-0434-4f6e-bbf7-576beba18962 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:31.977825 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-54dd3217-0434-4f6e-bbf7-576beba18962 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027894 Jul 28 06:21:31.981549 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 28 06:21:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:21:31.990229 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-a69ded7c-d50f-431d-a74b-81c52198bd56 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:31.995885 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.wsgi [None req-a69ded7c-d50f-431d-a74b-81c52198bd56 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-a69ded7c-d50f-431d-a74b-81c52198bd56 admin admin] Request method failure captured: Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Accept: application/json Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Accept-Encoding: gzip, deflate Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Connection: keep-alive Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Content-Length: 0 Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Host: 10.222.0.69 Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Openstack-Api-Version: compute 2.90 Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Openstack-System-Scope: None Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: User-Agent: python-novaclient Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Auth-Token: gAAAAABi4irrTVCPu4LwPlmMBDSPxYXWazUp1_t3UlnKSlrGbfpYF5wiKlIqGIDWizDRHgO458qTLXjn2T3EZnAiqWhqHVbaHWRk41Fghy3F48VQqa97iQsOMsJQuNTn-cKmUl4rBnBJgCzkIo4BfRKaT1Khi4KXKaTxMVfCxizuxAVt-nGS_SE Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Domain-Id: None Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Domain-Name: None Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Identity-Status: Confirmed Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Is-Admin-Project: True Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Domain-Id: default Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Domain-Name: Default Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Name: admin Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Role: admin,reader,member Jul 28 06:21:32.000023 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Roles: admin,reader,member Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05bb534ab3954f32aad6d8b3751d3ac9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}] Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant: admin Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant-Name: admin Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User: admin Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Domain-Id: default Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Domain-Name: Default Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Id: b42a77304cdd4ceda1f777fdc9b5ccf9 Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Name: admin Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: method: > Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: exception: Flavor 42 could not be found. Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: action_args: {'id': '42'} Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:21:32.001648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:32.002647 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:32.004009 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-a69ded7c-d50f-431d-a74b-81c52198bd56 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:21:32.005349 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-a69ded7c-d50f-431d-a74b-81c52198bd56 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015191 Jul 28 06:21:32.005349 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 28 06:21:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:32.989719 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-54dd3217-0434-4f6e-bbf7-576beba18962 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:32.990732 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-54dd3217-0434-4f6e-bbf7-576beba18962 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 28 06:21:32.991128 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:33.528176 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-da2c6e1e-d766-4b23-8c7b-97a11dc3ce76 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:33.531184 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.wsgi [None req-da2c6e1e-d766-4b23-8c7b-97a11dc3ce76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-da2c6e1e-d766-4b23-8c7b-97a11dc3ce76 admin admin] Request method failure captured: Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Accept: application/json Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Accept-Encoding: gzip, deflate Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Connection: keep-alive Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Content-Length: 0 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Host: 10.222.0.69 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Openstack-Api-Version: compute 2.90 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Openstack-System-Scope: None Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: User-Agent: python-novaclient Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Auth-Token: gAAAAABi4irseDjJaVaU-kYoKzvtWIHfalvp-rA9rgRKd86DzcIPV3WnDjb2xvoQ0RCP_XPb1jiSppysBfEbvFe7yuFJG6ZxABQKETI5Tb988Zo4_j4OdxYOVvyZNttRVzZMMct2yCDhfL48KoghpvI7y8fRgw8_xC7BywJS05zq5USJhXqWPv4 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Domain-Id: None Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Domain-Name: None Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Identity-Status: Confirmed Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Is-Admin-Project: True Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Domain-Id: default Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Domain-Name: Default Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Name: admin Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Role: admin,reader,member Jul 28 06:21:33.532744 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Roles: admin,reader,member Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05bb534ab3954f32aad6d8b3751d3ac9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}] Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant: admin Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant-Name: admin Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User: admin Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Domain-Id: default Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Domain-Name: Default Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Id: b42a77304cdd4ceda1f777fdc9b5ccf9 Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Name: admin Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: method: > Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: exception: Flavor 84 could not be found. Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: action_args: {'id': '84'} Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:21:33.534308 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:33.535256 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.536648 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-da2c6e1e-d766-4b23-8c7b-97a11dc3ce76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:21:33.538048 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-da2c6e1e-d766-4b23-8c7b-97a11dc3ce76 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404775 Jul 28 06:21:33.538048 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 28 06:21:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:33.547128 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-ddda418f-23d8-41bf-81a9-3d324ef00dc3 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:33.566442 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-ddda418f-23d8-41bf-81a9-3d324ef00dc3 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023884 Jul 28 06:21:33.567038 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 28 06:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:21:33.576970 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-0e73332f-38e2-411c-aa5c-26418399d560 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:33.592189 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-0e73332f-38e2-411c-aa5c-26418399d560 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018441 Jul 28 06:21:33.592712 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 28 06:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:21:33.602134 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f79ceaf7-e08a-406b-9bcc-d0294c75ba7c admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:33.608218 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.wsgi [None req-f79ceaf7-e08a-406b-9bcc-d0294c75ba7c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f79ceaf7-e08a-406b-9bcc-d0294c75ba7c admin admin] Request method failure captured: Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Accept: application/json Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Accept-Encoding: gzip, deflate Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Connection: keep-alive Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Content-Length: 0 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Host: 10.222.0.69 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Openstack-Api-Version: compute 2.90 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Openstack-System-Scope: None Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: User-Agent: python-novaclient Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Auth-Token: gAAAAABi4irseDjJaVaU-kYoKzvtWIHfalvp-rA9rgRKd86DzcIPV3WnDjb2xvoQ0RCP_XPb1jiSppysBfEbvFe7yuFJG6ZxABQKETI5Tb988Zo4_j4OdxYOVvyZNttRVzZMMct2yCDhfL48KoghpvI7y8fRgw8_xC7BywJS05zq5USJhXqWPv4 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Domain-Id: None Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Domain-Name: None Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Identity-Status: Confirmed Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Is-Admin-Project: True Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Domain-Id: default Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Domain-Name: Default Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Name: admin Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Role: admin,reader,member Jul 28 06:21:33.609749 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Roles: admin,reader,member Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05bb534ab3954f32aad6d8b3751d3ac9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}] Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant: admin Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant-Name: admin Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User: admin Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Domain-Id: default Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Domain-Name: Default Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Id: b42a77304cdd4ceda1f777fdc9b5ccf9 Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Name: admin Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: method: > Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: exception: Flavor 84 could not be found. Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: action_args: {'id': '84'} Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:21:33.611341 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:33.612313 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:33.614021 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f79ceaf7-e08a-406b-9bcc-d0294c75ba7c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:21:33.615259 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-f79ceaf7-e08a-406b-9bcc-d0294c75ba7c admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012520 Jul 28 06:21:33.615259 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 28 06:21:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 06:21:34.588904 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-0e73332f-38e2-411c-aa5c-26418399d560 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:34.589944 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-0e73332f-38e2-411c-aa5c-26418399d560 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 28 06:21:34.590341 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:35.123815 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f1a60cef-5e12-4036-b68d-89d25e50009a admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:35.130822 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.wsgi [None req-f1a60cef-5e12-4036-b68d-89d25e50009a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f1a60cef-5e12-4036-b68d-89d25e50009a admin admin] Request method failure captured: Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Accept: application/json Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Accept-Encoding: gzip, deflate Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Connection: keep-alive Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Content-Length: 0 Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Host: 10.222.0.69 Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Openstack-Api-Version: compute 2.90 Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Openstack-System-Scope: None Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: User-Agent: python-novaclient Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Auth-Token: gAAAAABi4iruy1nuRM2X9KerlutSg4qGujuQ69ThWKd4dMTn8O2dU0DeEC_DUJvBSyvu8A3lDrcJIzdLMc73y1QW2c8Wy97YM7z1M6OkwQNmKoHg0HUa1z8XVo6OTUtC56S2nG53h1pSMTMHqZ-7EoBjCS5h0en5DWXsHXB36KQy6h4LJqkse3o Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Domain-Id: None Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Domain-Name: None Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Identity-Status: Confirmed Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Is-Admin-Project: True Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Domain-Id: default Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Domain-Name: Default Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Project-Name: admin Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Role: admin,reader,member Jul 28 06:21:35.132380 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Roles: admin,reader,member Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05bb534ab3954f32aad6d8b3751d3ac9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}] Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant: admin Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-Tenant-Name: admin Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User: admin Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Domain-Id: default Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Domain-Name: Default Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Id: b42a77304cdd4ceda1f777fdc9b5ccf9 Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: X-User-Name: admin Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: method: > Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: exception: Flavor 451 could not be found. Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: action_args: {'id': '451'} Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:21:35.134063 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:35.135052 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.136407 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-f1a60cef-5e12-4036-b68d-89d25e50009a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103578) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:21:35.137729 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-f1a60cef-5e12-4036-b68d-89d25e50009a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405631 Jul 28 06:21:35.137729 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 28 06:21:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:35.152448 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-2e8f6a4d-a740-43b4-bdfe-e84b09ac114e admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:35.172284 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-2e8f6a4d-a740-43b4-bdfe-e84b09ac114e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027447 Jul 28 06:21:35.173174 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 28 06:21:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:21:35.186208 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:35.202201 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020250 Jul 28 06:21:35.202777 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 28 06:21:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:21:35.212659 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-31392595-363d-49b1-af07-cf5b6aacd667 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:35.218637 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.wsgi [None req-31392595-363d-49b1-af07-cf5b6aacd667 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-31392595-363d-49b1-af07-cf5b6aacd667 admin admin] Request method failure captured: Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Accept: application/json Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Accept-Encoding: gzip, deflate Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Connection: keep-alive Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Content-Length: 0 Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Host: 10.222.0.69 Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Openstack-Api-Version: compute 2.90 Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Openstack-System-Scope: None Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: User-Agent: python-novaclient Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Auth-Token: gAAAAABi4iruy1nuRM2X9KerlutSg4qGujuQ69ThWKd4dMTn8O2dU0DeEC_DUJvBSyvu8A3lDrcJIzdLMc73y1QW2c8Wy97YM7z1M6OkwQNmKoHg0HUa1z8XVo6OTUtC56S2nG53h1pSMTMHqZ-7EoBjCS5h0en5DWXsHXB36KQy6h4LJqkse3o Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Domain-Id: None Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Domain-Name: None Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Identity-Status: Confirmed Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Is-Admin-Project: True Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Domain-Id: default Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Domain-Name: Default Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Project-Name: admin Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Role: admin,reader,member Jul 28 06:21:35.220178 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Roles: admin,reader,member Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_05bb534ab3954f32aad6d8b3751d3ac9", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/05bb534ab3954f32aad6d8b3751d3ac9"}]}] Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant: admin Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant-Id: 05bb534ab3954f32aad6d8b3751d3ac9 Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-Tenant-Name: admin Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User: admin Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Domain-Id: default Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Domain-Name: Default Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Id: b42a77304cdd4ceda1f777fdc9b5ccf9 Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: X-User-Name: admin Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: method: > Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: exception: Flavor 451 could not be found. Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: action_args: {'id': '451'} Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:21:35.221790 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:35.222775 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: ERROR nova.api.openstack.wsgi Jul 28 06:21:35.224200 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-31392595-363d-49b1-af07-cf5b6aacd667 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103577) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:21:35.225478 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-31392595-363d-49b1-af07-cf5b6aacd667 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012635 Jul 28 06:21:35.225478 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 28 06:21:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 06:21:36.219788 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:36.220802 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 28 06:21:36.221195 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:36.746709 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-87907ba8-4368-4961-9309-259d3c766e5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:36.856335 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-87907ba8-4368-4961-9309-259d3c766e5f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.494097 Jul 28 06:21:36.856888 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 28 06:21:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:37.845464 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:37.846419 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 28 06:21:37.846817 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:38.385827 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-452ea58d-6f9f-43ea-b8db-e208174a44df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:38.459521 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-452ea58d-6f9f-43ea-b8db-e208174a44df admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.471599 Jul 28 06:21:38.459992 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 28 06:21:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:39.449576 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:39.450597 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 28 06:21:39.451132 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:39.984386 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-3fa4f23f-ffdf-4a82-aa91-61648ee14fbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:40.062439 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-3fa4f23f-ffdf-4a82-aa91-61648ee14fbc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.466486 Jul 28 06:21:40.063005 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 28 06:21:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:21:41.038297 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:41.039292 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 28 06:21:41.039710 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:41.572034 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-a9a727b4-8ae8-4a93-8624-c1796aed2738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:21:41.650390 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-a9a727b4-8ae8-4a93-8624-c1796aed2738 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.473962 Jul 28 06:21:41.650945 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 28 06:21:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:21:42.658928 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:42.659942 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 28 06:21:42.660345 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:21:43.189692 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-a1aea4c4-14ce-460d-b9c2-732c28ab7548 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:21:43.210029 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-a1aea4c4-14ce-460d-b9c2-732c28ab7548 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409838 Jul 28 06:21:43.210495 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Thu Jul 28 06:21:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:22:35.481632 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:22:35.482643 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-b3aa808d-72f7-4e00-b4c2-0be32133ab72 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 28 06:22:35.483050 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 28 06:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:22:35.493712 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:35.896503 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-c5ffa6cd-d9f9-4706-b9fe-b1397260ba09 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:22:35.917298 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-c5ffa6cd-d9f9-4706-b9fe-b1397260ba09 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428004 Jul 28 06:22:35.918381 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 28 06:22:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:22:35.940028 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG dbcounter [-] [103578] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:22:35.943738 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-1b9bdbed-4bc4-4627-918d-127a1bc0fe50 admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:22:35.951506 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-1b9bdbed-4bc4-4627-918d-127a1bc0fe50 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013048 Jul 28 06:22:35.952025 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Thu Jul 28 06:22:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:22:35.964042 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-ef2d2e38-5c9a-4e27-9fe6-70a362020cca admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:22:35.971955 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-ef2d2e38-5c9a-4e27-9fe6-70a362020cca admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011531 Jul 28 06:22:35.972481 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Thu Jul 28 06:22:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:22:35.984568 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:22:35.992981 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012052 Jul 28 06:22:35.993527 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Thu Jul 28 06:22:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:22:36.005695 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-af5df674-5a46-462d-844b-3e96073422c8 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:22:36.013500 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-af5df674-5a46-462d-844b-3e96073422c8 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011306 Jul 28 06:22:36.014026 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Thu Jul 28 06:22:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:26:06.379145 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:06.380463 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Jul 28 06:26:06.380870 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:26:06.523393 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_api:SELECT=6 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:06.687198 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-2dc45e07-93fd-46a1-8377-e9517540ad81 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:06.689666 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:26:06.689666 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: warnings.warn(msg) Jul 28 06:26:06.690866 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-2dc45e07-93fd-46a1-8377-e9517540ad81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:06.691878 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-2dc45e07-93fd-46a1-8377-e9517540ad81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:06.692679 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-2dc45e07-93fd-46a1-8377-e9517540ad81 admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:06.693099 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-2dc45e07-93fd-46a1-8377-e9517540ad81 admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:06.727556 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-2dc45e07-93fd-46a1-8377-e9517540ad81 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205503 Jul 28 06:26:06.728126 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 28 06:26:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:26:07.567545 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:07.568582 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 28 06:26:07.568980 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:26:07.767999 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-af2830a4-0dcd-4e71-83e0-bada06ff2b55 admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:07.771264 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:26:07.771264 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: warnings.warn(msg) Jul 28 06:26:07.772508 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-af2830a4-0dcd-4e71-83e0-bada06ff2b55 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:07.773018 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-af2830a4-0dcd-4e71-83e0-bada06ff2b55 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:07.773768 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-af2830a4-0dcd-4e71-83e0-bada06ff2b55 admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:07.774247 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-af2830a4-0dcd-4e71-83e0-bada06ff2b55 admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:07.794528 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-af2830a4-0dcd-4e71-83e0-bada06ff2b55 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080465 Jul 28 06:26:07.795078 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 28 06:26:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:26:19.037596 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:19.038677 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001868 Jul 28 06:26:19.039080 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 36/73] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:26:19.190484 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_cell0:SELECT=4 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:19.191230 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_cell1:SELECT=4 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:19.191859 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG dbcounter [-] [103577] Writing DB stats nova_api:SELECT=8 {{(pid=103577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:26:19.242575 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-6748a2b9-8985-4e83-9711-e7cad1d8c9fb admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:19.245046 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:26:19.245046 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: warnings.warn(msg) Jul 28 06:26:19.246318 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-6748a2b9-8985-4e83-9711-e7cad1d8c9fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:19.246762 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-6748a2b9-8985-4e83-9711-e7cad1d8c9fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:19.247556 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-6748a2b9-8985-4e83-9711-e7cad1d8c9fb admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:19.247981 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-6748a2b9-8985-4e83-9711-e7cad1d8c9fb admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:19.273381 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-6748a2b9-8985-4e83-9711-e7cad1d8c9fb admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087332 Jul 28 06:26:19.274055 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 38/74] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 28 06:26:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:26:20.124658 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: DEBUG nova.api.openstack.wsgi [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] Calling method '>' {{(pid=103578) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:20.125698 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: INFO nova.api.openstack.requestlog [None req-6f906be7-6ea8-401c-8f11-69160ef1ea2d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 28 06:26:20.126101 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: [pid: 103578|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 28 06:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:26:20.320837 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG nova.api.openstack.wsgi [None req-27e4f2d1-37c6-42c0-b887-6e6953acc58c admin admin] Calling method '>' {{(pid=103577) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:26:20.323364 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 06:26:20.323364 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: warnings.warn(msg) Jul 28 06:26:20.324605 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-27e4f2d1-37c6-42c0-b887-6e6953acc58c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:20.324993 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-27e4f2d1-37c6-42c0-b887-6e6953acc58c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:20.325940 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-27e4f2d1-37c6-42c0-b887-6e6953acc58c admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:26:20.326289 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: DEBUG oslo_concurrency.lockutils [None req-27e4f2d1-37c6-42c0-b887-6e6953acc58c admin admin] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103577) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:26:20.348548 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: INFO nova.api.openstack.requestlog [None req-27e4f2d1-37c6-42c0-b887-6e6953acc58c admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081513 Jul 28 06:26:20.349721 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: [pid: 103577|app: 0|req: 39/76] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 28 06:26:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:27:15.929325 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: Thu Jul 28 06:27:15 2022 - graceful shutdown triggered... Jul 28 06:27:15.929582 dv-cinder-812429-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 06:27:15.930291 dv-cinder-812429-2-iscsi devstack@n-api.service[103578]: Gracefully killing worker 2 (pid: 103578)... Jul 28 06:27:15.930664 dv-cinder-812429-2-iscsi devstack@n-api.service[103577]: Gracefully killing worker 1 (pid: 103577)... Jul 28 06:27:16.930484 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: worker 1 buried after 1 seconds Jul 28 06:27:16.931050 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: worker 2 buried after 1 seconds Jul 28 06:27:16.931050 dv-cinder-812429-2-iscsi devstack@n-api.service[103576]: goodbye to uWSGI. Jul 28 06:27:16.932077 dv-cinder-812429-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 06:27:16.932667 dv-cinder-812429-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 06:27:16.935552 dv-cinder-812429-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 06:27:16.946078 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 06:27:16 2022] *** Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: nodename: dv-cinder-812429-2-iscsi Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: machine: x86_64 Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: clock source: unix Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: pcre jit disabled Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: detected number of CPU cores: 4 Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: current working directory: / Jul 28 06:27:16.948094 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: detected binary path: /usr/bin/uwsgi-core Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: your processes number limit is 47680 Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: your memory page size is 4096 bytes Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: detected max file descriptor number: 2048 Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: lock engine: pthread robust mutexes Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: thunder lock: enabled Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 06:27:16.948757 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 06:27:16.988558 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: Python main interpreter initialized at 0x560938d079c0 Jul 28 06:27:16.988558 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: python threads support enabled Jul 28 06:27:16.988558 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: your server socket listen backlog is limited to 100 connections Jul 28 06:27:16.988558 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: your mercy for graceful operations on workers is 90 seconds Jul 28 06:27:16.989025 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 06:27:16.989025 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: *** Operational MODE: preforking *** Jul 28 06:27:16.989293 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: *** uWSGI is running in multiple interpreter mode *** Jul 28 06:27:16.989293 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: spawned uWSGI master process (pid: 118369) Jul 28 06:27:16.989556 dv-cinder-812429-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 06:27:16.991343 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: spawned uWSGI worker 1 (pid: 118387, cores: 1) Jul 28 06:27:16.991343 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: spawned uWSGI worker 2 (pid: 118388, cores: 1) Jul 28 06:27:16.991343 dv-cinder-812429-2-iscsi devstack@n-api.service[118369]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 06:27:17.679151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:27:17.680934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 06:27:18.859511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:27:18.859511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: from cryptography.utils import int_from_bytes Jul 28 06:27:18.860272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:27:18.860272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: from cryptography.utils import int_from_bytes Jul 28 06:27:18.877143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:27:18.877143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: from cryptography.utils import int_from_bytes Jul 28 06:27:18.877770 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 06:27:18.877770 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: from cryptography.utils import int_from_bytes Jul 28 06:27:21.293641 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:27:21.294300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:27:21.294575 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:27:21.294848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:27:21.295111 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:27:21.295514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.295850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.296178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.296509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.296849 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.297168 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.297527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.297861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.298197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.298464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.298788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.299122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812429-2-iscsi {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.299459 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.299961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.300285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.300623 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.300938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.301272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.301631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.302145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.304757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.304757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.304757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.304757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.304757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.304757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.305259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.305558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.305740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.306040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.306455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812429-2-iscsi {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.306784 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.307101 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.307424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.307863 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.308184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.308503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.308835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.309172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.309534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.309862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.310194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.310515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.310842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.311156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.311487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.311790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.312119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.312434 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.312743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.313001 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.313358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.313671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.313998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.314334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.314595 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.314852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.315180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.315510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.315827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.316141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.316455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.316767 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.317082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.317429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.317755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.318054 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.318511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.318827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.319161 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.319480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.319812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.320231 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.320487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.320801 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.321153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.321507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.321861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.322197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.322527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.323288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.323288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.323508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.323803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.324103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.324419 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.324671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.324979 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.325292 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.325638 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.325951 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.326264 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.326581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.326890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.327206 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.327516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.327831 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.328145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.328460 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.328773 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.329083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.329581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.330019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.330157 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.330394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.330714 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.331026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.331339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.331655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.331983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.332297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.332611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.332939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.333251 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.333608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.334060 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.334295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.334836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.335412 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.335970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.336376 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.336716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.338985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.339798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 06:27:21.340248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.340354 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 06:27:21.340511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.340807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 06:27:21.341375 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 06:27:21.341375 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 06:27:21.341791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.341956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.342104 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.342263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.342412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.342573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.342732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.342894 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.343046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.343213 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.343386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.343555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.343716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.343899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.344056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.344203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.344373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.344538 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.344695 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.344862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.345030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.345221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.345433 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812429-2-iscsi {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.345567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.345713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.345854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.345995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.346158 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.346307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.346455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.346603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.346751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.346896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.347339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.347487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.347658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.347814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.347969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.348127 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.348309 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.348485 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.348636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.348814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.348989 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.349151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.349283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.355948 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.356059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.356156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.356242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.356242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.356417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.356509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.356594 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.356671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.356750 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.356829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.356900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.356970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.357040 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.357109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.357187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812429-2-iscsi {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.357267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.358427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.358520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.358520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.358665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.358737 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.358814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.358886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.358955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.359033 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.359198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.359359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.359516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359594 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.359703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.359859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.360380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.360459 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.360537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.360614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.360691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.360768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.360847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.360919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.360988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.361067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.361146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.361229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.361766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.365298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.368960 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.369646 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.369760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.369861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.369958 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.370126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.370296 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.370453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370539 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.370617 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370689 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.370773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.370927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.370998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.371077 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.371158 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.371236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.371313 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.371391 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.371469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.371554 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.371636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.371719 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.371797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.371875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.371952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.372109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.372265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.372411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372553 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.372630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.372779 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.372861 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.372942 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.373013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.373083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.373152 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.373246 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.374269 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.374379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.374456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.374527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.374606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.374684 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.374762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.374847 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.374920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.374989 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.375067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.375139 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.375224 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.375297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.375377 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.375453 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.375531 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.375609 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.375692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.375771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.375850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.375921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.376001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.376235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376309 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.376378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376447 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.376525 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376604 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.376683 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376683 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.376919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.376997 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.377144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.377327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.377491 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377561 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.377630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.377779 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.377917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.377992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.378071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.378162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.378251 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.378347 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.378421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.379326 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.379412 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.379492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.379570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.379641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.379710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.379778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.379861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.379940 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.380010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.380100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.380178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.380248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.380344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.380419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.380607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.380696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.380839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.380961 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.381062 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.381200 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.381376 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.381544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.381688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.381827 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.381936 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.382010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.382154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.382366 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382444 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.382522 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.382677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.382842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.382921 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.383000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.383078 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.383149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.383218 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.383338 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.383429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.383670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.383753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.383987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.384069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.384322 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.384417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.384628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.384708 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.384932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.385014 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.385237 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.385384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.385584 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.385686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.385871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.385952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.386176 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.386267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.386476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.386564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.386775 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.386870 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.387092 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.387186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.387878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.387878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.388046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.388125 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.388344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.388431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.389382 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.389484 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.389558 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.389629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.389860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 06:27:21.389939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390323 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390397 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.390996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391238 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391415 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.391909 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.392167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.392249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.392479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.392573 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.393242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.393972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394157 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394315 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394472 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.394989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395173 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395444 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395619 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.395948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.396166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.396266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.397065 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.397166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.397446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.397596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.397757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.397904 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.398319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.398421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.398612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.398724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.399717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.399945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400048 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400123 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400205 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400499 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400654 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400891 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.400969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.401188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.401281 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.401528 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.401623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.401844 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.401935 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.402202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.402293 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.402518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.402599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.402833 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.402914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.403146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.403227 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.403477 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.403564 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.403795 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.403891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.404114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.404205 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.404429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.404510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.404745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.404825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.405071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.405160 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.405766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.405890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406138 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406495 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406723 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.406950 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407305 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407507 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.407955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.408145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.408263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.408482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.408620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.408775 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.408894 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.409780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.409928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.410924 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.411116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.411217 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.411587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.411696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.411784 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.411879 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.412643 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.412779 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.413009 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.413176 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.413339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.413546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.413669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.413893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414002 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414222 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414321 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414638 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.414984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.415193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.415291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.415505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.415596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.415821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.415921 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.416133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.416232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.416445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.416543 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.416757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.416856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.417069 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.417168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.417411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.417505 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.417726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.417819 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.418045 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.418144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.418358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.418449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.418688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.418779 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419316 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.419984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.420083 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.420284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.420427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.420597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.420748 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.420945 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.421153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.421284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.421473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.421655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.421756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.421969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.422062 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.422281 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.422390 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.422613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.422705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.422926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423238 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423343 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423547 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423647 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423858 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.423949 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.424170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.424275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.424483 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.424582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.424802 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.424901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.425119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.425277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.425460 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.425652 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.425778 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.425994 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.426106 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.426389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.426644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.426744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.426969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.427061 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.427293 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.427385 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.427636 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.427803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.427954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.428162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.428253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.428325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.428571 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.428723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.428897 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.429040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.429215 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.429382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.429576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.429697 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.429894 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.430102 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.430333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.430428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.430644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.430744 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.430957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431274 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.431992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.432232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.432331 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.432552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.432653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.432865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.432965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.433178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.433277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.433519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.433620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.433843 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.433956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.434153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.434256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.434473 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.434631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.434849 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.434942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.435207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.435506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.435832 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.435940 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.436148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.436254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.436476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.436577 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.436888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.437005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.437090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.437164 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.437421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.437570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.437784 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.438098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.438381 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.438485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.438713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.438818 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.439064 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.439232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.439405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.439791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.439956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.440363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.440544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.440698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.440883 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.441143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.441378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.441539 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.441703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.441902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.442064 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.442223 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.442376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.442533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.442721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.442879 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.443096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.443306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.443543 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.443792 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.444060 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.444248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.444401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.444553 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.444709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.444875 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.445034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.445186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.445374 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.445550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.445702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.445864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446496 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446647 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.446959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.447114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.447263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.447420 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.447589 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.447756 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.447914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448064 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448378 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.448986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.449142 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.449298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.449494 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.449675 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.450052 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.450222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.450477 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.450644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.450807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.450974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.451144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.451382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.451545 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.451696 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.451855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452815 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.452976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.453262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.453449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.453610 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.453767 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.453927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.454096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.454254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.454403 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.454562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.454721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.454871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455522 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455682 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.455991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.456159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.456319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.456470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.456470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.456769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.456920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.457070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.457233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.457422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.457422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.457726 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.457884 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.458035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.458204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.458355 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.458512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.458669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.458820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.459551 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.459826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.460333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.460573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.460734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.460901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.461066 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.461239 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.461421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.461584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.461749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.461899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.462057 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.462208 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.462208 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.462493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.462720 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.462873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463507 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463666 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463824 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.463982 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.464132 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.464281 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.464440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.464591 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.464740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.464740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.465039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.465199 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.465420 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.465586 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.465743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.465902 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466368 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466525 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466826 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.466982 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.467140 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.467306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.467468 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.467626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.467777 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.467933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468688 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.468996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.469153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.469343 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.469510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.469668 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.469826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.470069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.470430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.470603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.470766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.470928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471728 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471886 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.471886 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.472436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.472593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.472750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.472901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.473050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.473208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.473401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.473559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.473708 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.473866 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.474035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.474219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.474489 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.475206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.475441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.475697 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.475954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.476121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.476273 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.476423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.476573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.476730 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.476901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.477053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.477211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.477391 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.477556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.477714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.477879 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478330 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478636 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478802 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.478970 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.479122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.479273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.479429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.479588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.479738 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.479888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.480052 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.480211 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.480578 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.480746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.480915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.481067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.481067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.481422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.481577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.481741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.481741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482350 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.482960 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.483117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.483284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.483448 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.483606 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.483763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.483913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484219 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.484984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.485150 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.485337 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.485506 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.485706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.485864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486022 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486488 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.486973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.487137 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.487306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.487456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.487615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.487812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.487968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.488127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.488277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.488427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.488577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.488726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.488875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.489039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.489190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.489400 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.489557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.489719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.489876 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.490038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.490239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.490830 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491020 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491174 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491795 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.491965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.492116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.492279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.493050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.493231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.493430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.493599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.493760 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.493912 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.494069 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.494220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.494371 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.494598 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.494761 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.495091 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.495291 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.495458 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.495611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.495771 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.495923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.496080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.496237 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.496387 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.496537 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.496698 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.496860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497012 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497502 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.497966 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.498116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.498267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.498425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.498583 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.498741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.498903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499668 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.499973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.500131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.500290 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.500440 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.500597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.501003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.501185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.501395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.501567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.501726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.501878 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502027 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502345 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.502961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.503133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.503294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.503445 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.503602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.503760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.503918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.504069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.504232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.504390 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.504541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.504691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.504843 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.505005 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.505167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.505342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.505512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.505672 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.505866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.506109 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.506360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.506602 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.506763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.506924 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.507076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.507247 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.507413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.507565 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.507723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.507882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508201 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508672 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.508985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.509136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.509297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.509548 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.509708 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.509859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.510017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.510170 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.510320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.510478 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.510630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.510887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.511094 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.511250 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.511408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.511578 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.511731 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.511895 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512652 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.512969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.513120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.513270 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.513488 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.513651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.513817 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.513975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514434 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.515736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.515889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516039 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516355 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.516655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517540 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.517818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518461 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518712 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.518990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519076 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519346 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519433 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519696 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.519981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.520076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.520169 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.520256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.520568 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.520889 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.521227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.522138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.522478 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.522796 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.522991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.523162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.523327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.523487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.523640 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.523798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.524989 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.525147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.525299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.525484 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.525636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.525822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526818 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.526977 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.527147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.527298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.527456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.527614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.527774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.527932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.528092 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.528250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.528409 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.528568 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.528732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.528884 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.529057 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.529208 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.529422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.529624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.529781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.529938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.530096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.530096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.530382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.530545 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.530697 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.530854 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.531029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.531197 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.531367 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.531609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.531773 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.531925 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.532081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.532240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.532400 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.532552 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.532552 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.532847 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.533006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.533158 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.533345 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.533514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.533713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.533871 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.534029 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.534195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.534360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.534529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.534743 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.534898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.535049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.535222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.535397 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.535555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.535706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.535863 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536014 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536177 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536793 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.536944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.537733 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.537995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.538270 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.538479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.538635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.538792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.538955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.538955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.539250 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.539408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.539565 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.539728 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.539887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540372 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540524 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540683 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.540995 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.541147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.541419 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.541600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.541779 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.541983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.542483 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.542653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.542827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.542986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.542986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.543295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.543455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.543614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.543815 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.543985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544303 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544461 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.544932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.545232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.545441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.545596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.545746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.545910 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.546062 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.546220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.546379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.546529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.546688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.546850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547157 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547315 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547776 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.547934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.548086 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.548235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.548386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.548546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.548714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.548865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549355 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.549963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.550113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.550272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.550565 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.550721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.550721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.551033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.551184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.551346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.551572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.551737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.551890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.552040 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.552203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.552362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.552514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.552970 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.553145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.553369 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.553545 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.553706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.553865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554317 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554634 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.554860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.555171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.555171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.555552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.555552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.555845 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556160 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556324 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.556952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.557102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.557272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.557466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.557626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.557778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.557973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.558136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.558302 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.558454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.558605 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.558762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.558914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.559077 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.559229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.559396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.559547 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.559697 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.559848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.560008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.560205 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.560360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.560511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.560676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.560835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561000 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561157 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561343 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.561976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.562133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.562291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.562448 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.562599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.562763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.562921 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.563074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.563237 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.563409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.563567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.563726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.563877 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564033 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564033 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564506 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564828 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.564985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.565136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.565296 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.565505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.565689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.565845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566305 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.566922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.567079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.567238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.567407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.567558 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.567715 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.567873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.568023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.568174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.568366 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.568596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.568837 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.569090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.569289 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.569487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.569659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.569812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.569970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.570128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.570280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.570535 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.570716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.570888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.570888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.571184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.571344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.571508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.571659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.571820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.571982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.572140 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.572299 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.572453 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.572603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.572603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.572898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.573048 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.573224 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.573417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.573585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.573737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.573900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.574058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.574241 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.574467 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.574623 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.574773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.574922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575245 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.575407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.576607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.576607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.576607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.576607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.577180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.577367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.577562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.577904 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.578240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.578555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.578869 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.579181 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.579510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.579827 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.580148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.580459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.580779 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.581098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.581443 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.581761 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.582085 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.582387 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.582702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.583023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.583338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.583654 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.584502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.585011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.585534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.585866 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.586191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.586516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.586840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.587161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.587476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.587792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.588107 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.588427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.588763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.589084 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.589419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.589857 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.590177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.590502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.590829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.591144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.591473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.591802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.592209 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.592443 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.592759 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.593095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.593477 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.593813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.594143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.594455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.594767 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.595077 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.595395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.595720 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.596032 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.596342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.596650 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.596964 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.597562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.597876 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.598187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.598497 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.598809 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.599119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.599429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.600290 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.600607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.600914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.601220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.601562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.601874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.602185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.602498 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.602807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.603115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.603480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.603800 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.604119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.604446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.604761 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.605088 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.605425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.605753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.606077 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.606405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.606720 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.607057 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.607373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.607688 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.608004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.608317 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.608631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.608945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.609277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.609633 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.609946 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.610275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.610597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.610922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.611242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.611556 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.611890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.612203 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.612518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.612829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.613143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.613488 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.613807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.614119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.614433 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.614751 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.615068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.615487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.615842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.616242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.616578 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.616909 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.617261 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.617606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.617955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.618288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.618607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.618922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.619232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 06:27:21.619479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 06:27:21.634821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO dbcounter [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Registered counter for database nova_api Jul 28 06:27:21.656785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_db.sqlalchemy.engines [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.664252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writer thread running {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.681825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Registered counter for database nova_api Jul 28 06:27:21.701896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.708780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.720121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.context [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb(cell1) {{(pid=118388) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:27:21.725209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:27:21.726812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:27:21.727620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:27:21.729690 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:27:21.731711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO dbcounter [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Registered counter for database nova_cell0 Jul 28 06:27:21.735764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO dbcounter [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Registered counter for database nova_cell1 Jul 28 06:27:21.743626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_db.sqlalchemy.engines [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.745966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_db.sqlalchemy.engines [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.750967 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writer thread running {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.753645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writer thread running {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.768394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.context [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb(cell1) {{(pid=118387) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 06:27:21.773617 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:27:21.775781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:27:21.776600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:27:21.778694 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:27:21.780713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Registered counter for database nova_cell0 Jul 28 06:27:21.784762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Registered counter for database nova_cell1 Jul 28 06:27:21.792517 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.794856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.799289 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.905628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO dbcounter [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Registered counter for database nova_cell0 Jul 28 06:27:21.912621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_db.sqlalchemy.engines [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.917338 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writer thread running {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.945854 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:21.956336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO dbcounter [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Registered counter for database nova_cell0 Jul 28 06:27:21.966143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_db.sqlalchemy.engines [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 06:27:21.970855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writer thread running {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 06:27:22.243740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: WARNING keystonemiddleware.auth_token [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:27:22.251115 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: WARNING keystonemiddleware.auth_token [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:27:22.293438 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:27:22.300847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:27:22.598403 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: WARNING keystonemiddleware.auth_token [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:27:22.605795 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: WARNING keystonemiddleware.auth_token [None req-18576727-98b1-4153-95d9-6654d6dfb2d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:27:22.611146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560938d079c0 pid: 118388 (default app) Jul 28 06:27:22.654923 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 06:27:22.660948 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: WARNING keystonemiddleware.auth_token [None req-2a6cb624-a2f0-4e2e-9bed-4ff0018840de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 06:27:22.667045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560938d079c0 pid: 118387 (default app) Jul 28 06:28:05.866303 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:05.867190 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:05.868006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:05.869085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:06.825086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f8985e5f-8e76-40d7-8977-8ec779e0aed1 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Action: 'create', calling method: .version_select at 0x7fbe63c93ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-510204581", "metadata": {"Type": "work"}}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f8985e5f-8e76-40d7-8977-8ec779e0aed1 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Request method failure captured: Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 121 Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4ix18f0m0i5r9CixAZn-DqMYRSFOu0MWcBYTkzK_xI3t-vbhtQrhYyZJj1y0QEs72sjSnYCQ5YqsfuZpb9an3JOFs_Jr3hCNbWf2pJ5zrhGj440AmYZRuvC8EF-XNDatJGh5Xqrsq5neeNLtTmElH_7Dfx2iJ9VzS6GCp8AEXwafqv4 Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:28:06.835620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fc0bbee6f2334c599f7756b95c9d46dc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}] Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 5cc5c21a50d5452a8b9b9829f69ad0d2 Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-510204581", "metadata": {"Type": "work"}}} Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: Jul 28 06:28:06.837098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-510204581', 'metadata': {'Type': 'work'}}}} Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise error Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:28:06.837966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 06:28:06.839318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 06:28:06.840601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 06:28:06.840601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:06.843970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f8985e5f-8e76-40d7-8977-8ec779e0aed1 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:28:06.848628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f8985e5f-8e76-40d7-8977-8ec779e0aed1 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.991521 Jul 28 06:28:06.848628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Jul 28 06:28:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 994 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:28:06.860708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:06.861461 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:06.862463 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:06.864772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-641dfa69-3121-4b24-9615-8f021b597732 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Action: 'create', calling method: .version_select at 0x7fbe63c628b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-525688968", "metadata": {"Type": "work"}}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-641dfa69-3121-4b24-9615-8f021b597732 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Request method failure captured: Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 119 Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4ix18f0m0i5r9CixAZn-DqMYRSFOu0MWcBYTkzK_xI3t-vbhtQrhYyZJj1y0QEs72sjSnYCQ5YqsfuZpb9an3JOFs_Jr3hCNbWf2pJ5zrhGj440AmYZRuvC8EF-XNDatJGh5Xqrsq5neeNLtTmElH_7Dfx2iJ9VzS6GCp8AEXwafqv4 Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:28:07.393072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fc0bbee6f2334c599f7756b95c9d46dc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}] Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 5cc5c21a50d5452a8b9b9829f69ad0d2 Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-525688968", "metadata": {"Type": "work"}}} Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: Jul 28 06:28:07.402034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-525688968', 'metadata': {'Type': 'work'}}}} Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise error Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi '0' Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:28:07.403506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 06:28:07.404887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 06:28:07.406267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 06:28:07.406267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.406267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-641dfa69-3121-4b24-9615-8f021b597732 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:28:07.406267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-641dfa69-3121-4b24-9615-8f021b597732 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.464536 Jul 28 06:28:07.406267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 1/2] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Jul 28 06:28:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 467 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0246941d-a60b-467d-a56f-f11d5decd3fe tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Action: 'create', calling method: .version_select at 0x7fbe63b7b790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-705942704", "metadata": {"Type": "work"}}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0246941d-a60b-467d-a56f-f11d5decd3fe tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Request method failure captured: Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 118 Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4ix18f0m0i5r9CixAZn-DqMYRSFOu0MWcBYTkzK_xI3t-vbhtQrhYyZJj1y0QEs72sjSnYCQ5YqsfuZpb9an3JOFs_Jr3hCNbWf2pJ5zrhGj440AmYZRuvC8EF-XNDatJGh5Xqrsq5neeNLtTmElH_7Dfx2iJ9VzS6GCp8AEXwafqv4 Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:28:07.406602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fc0bbee6f2334c599f7756b95c9d46dc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}] Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 5cc5c21a50d5452a8b9b9829f69ad0d2 Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-705942704", "metadata": {"Type": "work"}}} Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: Jul 28 06:28:07.408191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-705942704', 'metadata': {'Type': 'work'}}}} Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise error Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi '' Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:28:07.409085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 06:28:07.410426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 06:28:07.417685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 06:28:07.417685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:07.417685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0246941d-a60b-467d-a56f-f11d5decd3fe tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:28:07.417685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0246941d-a60b-467d-a56f-f11d5decd3fe tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029446 Jul 28 06:28:07.417685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 2/3] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Jul 28 06:28:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:28:07.418336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-032cba99-b59c-4d0e-a995-67dbd5b7ab6d tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Calling method '.version_select at 0x7fbe64475160>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-032cba99-b59c-4d0e-a995-67dbd5b7ab6d tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] HTTP exception thrown: Volume tempest-invalid-1139836326 could not be found. Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-032cba99-b59c-4d0e-a995-67dbd5b7ab6d tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Request method failure captured: Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1139836326 HTTP/1.1 Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4ix18f0m0i5r9CixAZn-DqMYRSFOu0MWcBYTkzK_xI3t-vbhtQrhYyZJj1y0QEs72sjSnYCQ5YqsfuZpb9an3JOFs_Jr3hCNbWf2pJ5zrhGj440AmYZRuvC8EF-XNDatJGh5Xqrsq5neeNLtTmElH_7Dfx2iJ9VzS6GCp8AEXwafqv4 Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:28:08.403081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fc0bbee6f2334c599f7756b95c9d46dc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}] Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 5cc5c21a50d5452a8b9b9829f69ad0d2 Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Volume tempest-invalid-1139836326 could not be found. Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'tempest-invalid-1139836326'} Jul 28 06:28:08.409569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1139836326 could not be found. (HTTP 404) (Request-ID: req-4e217399-5fea-4d01-916a-9933871a097f) Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:08.411024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:28:08.413124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1139836326 could not be found. Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:28:08.414804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1139836326 could not be found. Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1139836326 could not be found. Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-032cba99-b59c-4d0e-a995-67dbd5b7ab6d tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Returning 404 to user: Volume tempest-invalid-1139836326 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-032cba99-b59c-4d0e-a995-67dbd5b7ab6d tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1139836326" status: 404 len: 99 microversion: 2.1 time: 0.919407 Jul 28 06:28:08.416312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Jul 28 06:28:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1139836326 => generated 99 bytes in 926 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 06:28:08.421354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a50eb1e5-1217-4036-a95d-6f1e60110c79 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003897 Jul 28 06:28:08.421354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 3/5] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Jul 28 06:28:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 06:28:08.423506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bdd146d6-1d48-494f-a980-9644c566cd6d tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004796 Jul 28 06:28:08.423506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 3/6] 10.222.0.69 () {58 vars in 1137 bytes} [Thu Jul 28 06:28:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 06:28:08.423774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ba8686c6-daad-4b07-a8ca-3f6e37dbf138 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Calling method '.version_select at 0x7fbe63b4ba60>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:08.765469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-ba8686c6-daad-4b07-a8ca-3f6e37dbf138 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] HTTP exception thrown: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ba8686c6-daad-4b07-a8ca-3f6e37dbf138 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Request method failure captured: Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: DELETE /compute/v2.1/os-volumes/e7ee0962-903e-44c9-811a-56875f9f7ad9 HTTP/1.1 Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4ix18f0m0i5r9CixAZn-DqMYRSFOu0MWcBYTkzK_xI3t-vbhtQrhYyZJj1y0QEs72sjSnYCQ5YqsfuZpb9an3JOFs_Jr3hCNbWf2pJ5zrhGj440AmYZRuvC8EF-XNDatJGh5Xqrsq5neeNLtTmElH_7Dfx2iJ9VzS6GCp8AEXwafqv4 Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:28:08.771650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fc0bbee6f2334c599f7756b95c9d46dc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}] Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 5cc5c21a50d5452a8b9b9829f69ad0d2 Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'e7ee0962-903e-44c9-811a-56875f9f7ad9'} Jul 28 06:28:08.772835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. (HTTP 404) (Request-ID: req-3e5fa693-8260-4b56-9316-9a89a825db7b) Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:08.773573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:28:08.774653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 06:28:08.775815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:28:08.776856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ba8686c6-daad-4b07-a8ca-3f6e37dbf138 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Returning 404 to user: Volume e7ee0962-903e-44c9-811a-56875f9f7ad9 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:28:08.778507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ba8686c6-daad-4b07-a8ca-3f6e37dbf138 tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/e7ee0962-903e-44c9-811a-56875f9f7ad9" status: 404 len: 109 microversion: 2.1 time: 0.454135 Jul 28 06:28:08.779661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:28:08 2022] DELETE /compute/v2.1/os-volumes/e7ee0962-903e-44c9-811a-56875f9f7ad9 => generated 109 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:28:08.791174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-35802b70-e722-41c0-b7cd-f112af26d53b tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Calling method '.version_select at 0x7fbe63bd7c10>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:09.047031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-35802b70-e722-41c0-b7cd-f112af26d53b tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] HTTP exception thrown: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-35802b70-e722-41c0-b7cd-f112af26d53b tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Request method failure captured: Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/os-volumes/b75085a1-d8db-4e92-b6a0-8aca8cc009d9 HTTP/1.1 Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4ix18f0m0i5r9CixAZn-DqMYRSFOu0MWcBYTkzK_xI3t-vbhtQrhYyZJj1y0QEs72sjSnYCQ5YqsfuZpb9an3JOFs_Jr3hCNbWf2pJ5zrhGj440AmYZRuvC8EF-XNDatJGh5Xqrsq5neeNLtTmElH_7Dfx2iJ9VzS6GCp8AEXwafqv4 Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:28:09.048984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fc0bbee6f2334c599f7756b95c9d46dc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fc0bbee6f2334c599f7756b95c9d46dc"}]}] Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: fc0bbee6f2334c599f7756b95c9d46dc Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-1998254972 Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 5cc5c21a50d5452a8b9b9829f69ad0d2 Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-1998254972-project Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b75085a1-d8db-4e92-b6a0-8aca8cc009d9'} Jul 28 06:28:09.050685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. (HTTP 404) (Request-ID: req-c888370b-65d6-454a-b58e-03adde84c439) Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:09.051364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:28:09.052539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:28:09.053671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-35802b70-e722-41c0-b7cd-f112af26d53b tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] Returning 404 to user: Volume b75085a1-d8db-4e92-b6a0-8aca8cc009d9 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-35802b70-e722-41c0-b7cd-f112af26d53b tempest-VolumesNegativeTest-1998254972 tempest-VolumesNegativeTest-1998254972-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/b75085a1-d8db-4e92-b6a0-8aca8cc009d9" status: 404 len: 109 microversion: 2.1 time: 0.263813 Jul 28 06:28:09.054764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:28:08 2022] GET /compute/v2.1/os-volumes/b75085a1-d8db-4e92-b6a0-8aca8cc009d9 => generated 109 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:28:18.189639 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-30775912", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "networks": [{"uuid": "e07e6c95-817a-4822-8866-5c83ae701fa7"}]}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:18.448389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] validate_networks() for [('e07e6c95-817a-4822-8866-5c83ae701fa7', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:28:20.720674 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:28:20.721455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:28:20.722020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:28:20.722431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:28:20.722839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:28:20.751079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:20.753576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:20.754746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:20.756579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:20.838295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Getting quotas for project 58565c8c6b5743278fb155d39ed65e3d. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:20.862640 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Getting quotas for user eda0cfe646954a9a8476b346ac9fed72 and project 58565c8c6b5743278fb155d39ed65e3d. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:20.924822 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:28:20.937254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:28:21.266458 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bb7c4b42-a48f-4661-82fe-71672db882e0 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.354981 Jul 28 06:28:21.267758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 5/9] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:28:21.282378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6048fe31-e206-443a-b4d0-35f51063d554 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:21.283171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6048fe31-e206-443a-b4d0-35f51063d554 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:21.616246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6048fe31-e206-443a-b4d0-35f51063d554 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:21.645040 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6048fe31-e206-443a-b4d0-35f51063d554 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1213 microversion: 2.1 time: 0.368214 Jul 28 06:28:21.661407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 5/10] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:21 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:22.593007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1880854993", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:22.668317 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bd6fd37c-431b-47eb-8b33-6517defbe344 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:22.668858 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] validate_networks() for [('c6978cd1-c187-431b-a4d2-24672b7a1261', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:28:22.669662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bd6fd37c-431b-47eb-8b33-6517defbe344 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:23.140865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bd6fd37c-431b-47eb-8b33-6517defbe344 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:23.149288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bd6fd37c-431b-47eb-8b33-6517defbe344 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1213 microversion: 2.1 time: 0.484143 Jul 28 06:28:23.170050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 6/11] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:22 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1213 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:24.177953 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-52975918-e3c3-419e-96b6-e8fab0aee0f6 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:24.178661 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-52975918-e3c3-419e-96b6-e8fab0aee0f6 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:24.464753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-52975918-e3c3-419e-96b6-e8fab0aee0f6 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:24.480138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-52975918-e3c3-419e-96b6-e8fab0aee0f6 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1213 microversion: 2.1 time: 0.307042 Jul 28 06:28:24.480723 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 7/12] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:24 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1213 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:24.749545 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:28:24.750084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:28:24.750658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:28:24.751296 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:28:24.751829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:28:24.782845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:24.785644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:24.787955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:24.789902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:24.863735 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for project cd88554db98441c99e0b09b446c24b47. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:24.887215 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for user 86a5553819d949ffbc64b7a388942baf and project cd88554db98441c99e0b09b446c24b47. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:24.912240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:28:24.918719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:28:25.199144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7708cd1a-875b-4942-a976-56f98035d3ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.894383 Jul 28 06:28:25.204437 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 6/13] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:28:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:28:25.216609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-395f2660-17e8-40cd-9848-38df927bdb9d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:25.218014 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-395f2660-17e8-40cd-9848-38df927bdb9d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:25.420696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-395f2660-17e8-40cd-9848-38df927bdb9d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:25.445182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-395f2660-17e8-40cd-9848-38df927bdb9d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1222 microversion: 2.1 time: 0.217699 Jul 28 06:28:25.448362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 8/14] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:25 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:25.508313 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:25.512612 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:25.517459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:25.518504 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:25.528724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:25.529240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:25.948647 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:26.015298 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dfb8679e-086a-4a25-8011-b6c532503c6b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1209 microversion: 2.1 time: 0.500372 Jul 28 06:28:26.021762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 9/15] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:25 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1209 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:26.035310 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-103327912", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:26.198806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d8e7f4a1-0f66-47bf-ac99-95fa1bf57f8a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: .version_select at 0x7fbe6319d820>, body: {"keypair": {"name": "tempest-keypair-1854749797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOIIEQQn3dtn6bpbTcO+YmZrMLsVIvMa1AAIoBii06TswYp8b8AAzam6Gah0tVe9BVolnaMpGi8GnYHzaF1Z8SQK6iYpLD97w8TkCFgTBxOMQ7IqEMDxsWfAYuFIZypUw=="}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:26.284090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-d8e7f4a1-0f66-47bf-ac99-95fa1bf57f8a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:26.289244 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-d8e7f4a1-0f66-47bf-ac99-95fa1bf57f8a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:26.347746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] validate_networks() for [('c6978cd1-c187-431b-a4d2-24672b7a1261', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:28:26.526859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d8e7f4a1-0f66-47bf-ac99-95fa1bf57f8a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.065625 Jul 28 06:28:26.535668 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 7/16] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:28:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:27.045190 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:27.046424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:27.080996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:27.082905 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:27.101242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:27.119205 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:27.867462 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:27.924765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7d7a5ff0-754d-4436-83e7-e049092fde05 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1283 microversion: 2.1 time: 0.884013 Jul 28 06:28:27.926821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 8/17] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:27 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1283 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:28.866613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b1fd3e1d-6c43-4fba-b09f-42a69e488c95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'create', calling method: .version_select at 0x7fbe62069940>, body: {"keypair": {"name": "tempest-keypair-1600114702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiZtzZ5R1U5aN/CpMK+E9gY0mVsLVmH/aiFW5Z+QMANAq8tQA0WSsAu+KyEE2xoZj+GWgiXd/EQH8orAYCOvYlgngYoLAraWhI13ulISlj1SvRUo+HAAl80Ps3IhGg1Vw=="}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:28.925495 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-b1fd3e1d-6c43-4fba-b09f-42a69e488c95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:28.935362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-b1fd3e1d-6c43-4fba-b09f-42a69e488c95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for user 6d4528589ffa478689e905d47e4c37ee and project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:29.054587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b1fd3e1d-6c43-4fba-b09f-42a69e488c95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.125761 Jul 28 06:28:29.056503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 9/18] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Jul 28 06:28:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 06:28:29.069093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:29.070094 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:29.100084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:29.100541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:29.110822 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:29.112070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:29.223097 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:28:29.224466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:28:29.228411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:28:29.228411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:28:29.228411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:28:29.257324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:29.257324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:29.257324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:29.257324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:29.317501 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:29.327625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f51fdfd6-6845-48db-8829-038148d6ac5a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1271 microversion: 2.1 time: 0.269964 Jul 28 06:28:29.331888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 10/19] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:29 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:29.348162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for project cd88554db98441c99e0b09b446c24b47. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:29.374874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for user 86a5553819d949ffbc64b7a388942baf and project cd88554db98441c99e0b09b446c24b47. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:29.392282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:28:29.396131 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:28:29.705150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e36bb023-dcd4-4298-bbe7-72a9f6effaec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.676965 Jul 28 06:28:29.706463 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 10/20] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:28:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:28:29.718915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5e54581-7c0f-4798-aaed-ef2102c3bdcc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:29.719836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5e54581-7c0f-4798-aaed-ef2102c3bdcc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:29.924758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f5e54581-7c0f-4798-aaed-ef2102c3bdcc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:29.952510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5e54581-7c0f-4798-aaed-ef2102c3bdcc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1221 microversion: 2.1 time: 0.238321 Jul 28 06:28:29.970467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 11/21] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:29 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:30.362613 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:30.363289 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:30.406306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:30.419415 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:30.420273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:30.420962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:30.803846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:30.819883 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1df2f606-f9ab-473b-aab6-da4339586aa3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1271 microversion: 2.1 time: 0.463171 Jul 28 06:28:30.835274 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 11/22] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:30 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1271 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:30.979252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b4186ccf-3856-455a-bbc3-6ebfdd03d95f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:30.980000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b4186ccf-3856-455a-bbc3-6ebfdd03d95f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:31.192926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b4186ccf-3856-455a-bbc3-6ebfdd03d95f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:31.218245 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b4186ccf-3856-455a-bbc3-6ebfdd03d95f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1221 microversion: 2.1 time: 0.246312 Jul 28 06:28:31.223394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 12/23] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:30 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1221 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:31.848724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:31.849611 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:31.886222 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:31.888276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:31.893104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:31.901020 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:32.620750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-40b95649-e063-4425-81fe-cffcdb6742f4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: .version_select at 0x7fbe6319a040>, body: {"keypair": {"name": "tempest-keypair-134610821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDh7bHXJeAUB8Uaj1k+oTMXSp108tq6wqx/D9o9Vx54sKRmyoL2YnUUf2zvX3Yko98bfFtUsV/205g0e0RPXBi/dML2rCW9rormBmN1YEtRWAgIBoh6cAyqyf3NY4iXWow=="}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:32.696964 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-40b95649-e063-4425-81fe-cffcdb6742f4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:32.732592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-40b95649-e063-4425-81fe-cffcdb6742f4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for user 0d268e37c8b64bcc9261a80bb0461edc and project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:32.947258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-40b95649-e063-4425-81fe-cffcdb6742f4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.823937 Jul 28 06:28:32.949146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 13/24] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:28:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:32.955611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:32.956320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:32.987806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:32.987806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:32.987806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:32.996988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:33.090969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:33.103962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4d513bcc-84ef-445a-9729-3ce7a8c9b1e2 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 1.261716 Jul 28 06:28:33.111677 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 12/25] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:31 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:33.327227 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:33.339729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4420d0fa-4ed1-4033-aa91-27f6c5e2fd4c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1273 microversion: 2.1 time: 0.389378 Jul 28 06:28:33.343933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 14/26] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:32 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1273 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:34.138850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:34.139481 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:34.177717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:34.180715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:34.183075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:34.198026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:34.367258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:34.367993 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:34.379699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:34.387980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:34.388955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:34.389433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:34.804866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=4 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:35.120162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:35.134698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-032155b5-9432-448e-b5ac-e14feb6f431c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1291 microversion: 2.1 time: 0.771920 Jul 28 06:28:35.135468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 15/27] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:34 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1291 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:35.825342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:35.841501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0ffea544-cfe7-4d7c-850c-5d1efb93b9cf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 1.707144 Jul 28 06:28:35.865340 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 13/28] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:34 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:36.164628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:36.165364 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:36.197429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:36.198794 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:36.200908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:36.205835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:36.430764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:36.442671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4b2952ae-9e60-4217-83c6-235c16da94fd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1279 microversion: 2.1 time: 0.281840 Jul 28 06:28:36.446193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 16/29] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:36 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:36.879386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:36.880569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:36.901412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:36.901412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:36.901412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:36.901622 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:37.530824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:37.530824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:37.530824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:37.530824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:37.534534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:37.534534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:37.792288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:37.837663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-74e69119-9259-4881-b5a9-f45860a42fed tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1279 microversion: 2.1 time: 0.371577 Jul 28 06:28:37.849764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 17/30] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:37 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:38.548954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:38.565814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-01e9a9ec-63ae-4c6b-ad5e-f9e23719c7e1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 1.690751 Jul 28 06:28:38.584023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 14/31] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:36 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:38.873918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:38.873918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:38.900217 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:38.908898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:38.911767 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:38.917926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:39.602278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:39.603582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:39.620451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:39.621933 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=14 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:39.623559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:39.624016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:39.624798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:39.625246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:39.692430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:39.701018 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1afa3be8-7bb4-470c-b053-6fd0b6edcb71 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1279 microversion: 2.1 time: 0.841128 Jul 28 06:28:39.708600 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 18/32] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:38 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1279 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:40.284390 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-b197a2ca-aba0-4d7f-9395-693061b702d7 req-075b92b8-7564-4173-92d5-95a1c300c6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d8c679-5516-46fb-a7e5-f9f46d2c17f6", "tag": "a47764d3-1a16-4912-b7f4-99264deba837"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:40.313051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-b197a2ca-aba0-4d7f-9395-693061b702d7 req-075b92b8-7564-4173-92d5-95a1c300c6db service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:40.313670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-b197a2ca-aba0-4d7f-9395-693061b702d7 req-075b92b8-7564-4173-92d5-95a1c300c6db service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:40.380360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-b197a2ca-aba0-4d7f-9395-693061b702d7 req-075b92b8-7564-4173-92d5-95a1c300c6db service nova] Creating event network-changed:a47764d3-1a16-4912-b7f4-99264deba837 for instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 on hv-cinder-81242 Jul 28 06:28:40.382141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-b197a2ca-aba0-4d7f-9395-693061b702d7 req-075b92b8-7564-4173-92d5-95a1c300c6db service nova] Acquired lock "compute-rpcapi-router" {{(pid=118388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 06:28:40.401906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:40.404832 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:40.410151 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:40.410151 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:40.429446 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.compute.rpcapi [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 06:28:40.437256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] Releasing lock "compute-rpcapi-router" {{(pid=118388) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 06:28:40.497381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ab9dbd35-cccb-4f4c-ad95-da2b1e980eee None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344045 Jul 28 06:28:40.501527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 19/33] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:40.511460 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1362814717", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbc8d74-4a13-4069-9d84-f85f9df7bdf6"}], "security_groups": [{"name": "tempest-securitygroup--560795461"}], "key_name": "tempest-keypair-1854749797", "user_data": "}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:41.159340 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:41.175485 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f8eef2f8-dc83-4a6f-aec1-8eacdd3d6c3e tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 1.579367 Jul 28 06:28:41.177155 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 15/34] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:39 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:41.188968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:41.193703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:41.225797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:41.226734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:41.227705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:41.228295 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:42.038288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] validate_networks() for [('fbbc8d74-4a13-4069-9d84-f85f9df7bdf6', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:28:42.769508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=28 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:43.386763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:43.414387 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eb0aed5e-39d7-47cb-bdf7-c3a6777ab501 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 2.233967 Jul 28 06:28:43.416368 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 16/35] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:41 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:43.440505 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:43.442111 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:43.460302 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:43.462167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:43.466170 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:43.466642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:44.506237 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:44.514535 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-86ddf177-4145-43fe-8982-fbd7ed8b7c22 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 1.080837 Jul 28 06:28:44.517715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 17/36] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:43 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:44.677150 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:28:44.683280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:28:44.684064 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:28:44.684840 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:28:44.687607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:28:44.730090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:44.736464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:44.736464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:44.737724 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:44.788584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:44.805411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:44.815227 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:44.863134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:28:44.865586 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:28:45.078570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-492d0c94-5417-48f3-ace9-366a6ce52d16 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.575261 Jul 28 06:28:45.090990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-66853cca-3ce6-4be8-98f6-c14d82497ca6 req-6e5b6a10-d95b-4d63-8a12-d17a50815293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304ff8e1-a50f-4e7e-a0df-39476ea30e25", "tag": "2820efb3-8d20-487d-8462-76666e80919c"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:45.096806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 20/37] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:28:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 4594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:28:45.113203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:45.113876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:45.132821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.132983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-66853cca-3ce6-4be8-98f6-c14d82497ca6 req-6e5b6a10-d95b-4d63-8a12-d17a50815293 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.133263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-66853cca-3ce6-4be8-98f6-c14d82497ca6 req-6e5b6a10-d95b-4d63-8a12-d17a50815293 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:45.134084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:45.135580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.136083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:45.193526 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-66853cca-3ce6-4be8-98f6-c14d82497ca6 req-6e5b6a10-d95b-4d63-8a12-d17a50815293 service nova] Creating event network-changed:2820efb3-8d20-487d-8462-76666e80919c for instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 on hv-cinder-81242 Jul 28 06:28:45.195758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-66853cca-3ce6-4be8-98f6-c14d82497ca6 req-6e5b6a10-d95b-4d63-8a12-d17a50815293 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 06:28:45.198617 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.201126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:45.202216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.205687 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:45.232700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.compute.rpcapi [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 06:28:45.232700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 06:28:45.284011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6d620a89-e5d8-47bc-889d-54ff1802b2e4 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.756569 Jul 28 06:28:45.284011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 18/38] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:45.290587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b452522b-97fa-43e6-b968-4c4e8b774c58 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:45.291302 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b452522b-97fa-43e6-b968-4c4e8b774c58 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:45.770587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b452522b-97fa-43e6-b968-4c4e8b774c58 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:45.781581 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b452522b-97fa-43e6-b968-4c4e8b774c58 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1242 microversion: 2.1 time: 0.498925 Jul 28 06:28:45.783395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 19/39] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:45 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1242 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:45.800358 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:45.800977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:45.815781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.817053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:45.818185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:45.818630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:46.168074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:46.192333 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bbaeb213-0e73-46e5-b1b7-eedcdb271738 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 1.094116 Jul 28 06:28:46.194687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 21/40] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:45 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:46.213842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1297511815", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5e9eeda-6e9e-4dd6-a6c3-14c5caf4bc34"}], "security_groups": [{"name": "tempest-securitygroup--153340668"}], "key_name": "tempest-keypair-1600114702", "user_data": "}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:46.346249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:46.374001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0947156d-4433-4f99-886f-fe8bd681a864 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.589255 Jul 28 06:28:46.374621 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 20/41] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:45 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:46.642699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] validate_networks() for [('b5e9eeda-6e9e-4dd6-a6c3-14c5caf4bc34', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:28:46.849276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c719cbde-d801-403b-b33b-c3e27bb176bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:46.849276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c719cbde-d801-403b-b33b-c3e27bb176bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:46.994294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c719cbde-d801-403b-b33b-c3e27bb176bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:47.003740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c719cbde-d801-403b-b33b-c3e27bb176bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1242 microversion: 2.1 time: 0.203845 Jul 28 06:28:47.004337 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 21/42] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:46 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1242 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:47.012278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-263530ff-7753-4df9-a0b2-65fe2228b7f4 req-60846d7a-f21b-4573-b7fc-b1ff9e781853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cca25c-8de5-474c-894c-13860e7f2146", "tag": "311a1ab8-32bf-407e-8d50-784a681fe39e"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:47.023749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-263530ff-7753-4df9-a0b2-65fe2228b7f4 req-60846d7a-f21b-4573-b7fc-b1ff9e781853 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.024460 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-263530ff-7753-4df9-a0b2-65fe2228b7f4 req-60846d7a-f21b-4573-b7fc-b1ff9e781853 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.037830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-263530ff-7753-4df9-a0b2-65fe2228b7f4 req-60846d7a-f21b-4573-b7fc-b1ff9e781853 service nova] Creating event network-changed:311a1ab8-32bf-407e-8d50-784a681fe39e for instance c5cca25c-8de5-474c-894c-13860e7f2146 on hv-cinder-81242 Jul 28 06:28:47.056875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-263530ff-7753-4df9-a0b2-65fe2228b7f4 req-60846d7a-f21b-4573-b7fc-b1ff9e781853 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050711 Jul 28 06:28:47.061692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 22/43] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:47.223593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:47.230529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:47.241693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.242416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.243455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.244087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.512774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:47.532513 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d41a849f-87e1-4cdc-8a22-f4927fffaf23 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.313344 Jul 28 06:28:47.547549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 23/44] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:47 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:47.552094 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:28:47.552662 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:28:47.553028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:28:47.553621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:28:47.554233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:28:47.554744 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:47.555371 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:47.561929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.562395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.563408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.564034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.566011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.566731 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.567828 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:47.568468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:47.591445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:47.605870 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for user 6d4528589ffa478689e905d47e4c37ee and project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:47.619686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:28:47.622698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:28:47.735704 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:47.743678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0703617d-1c2e-430a-b5f9-5b6d38853393 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.192637 Jul 28 06:28:47.744431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 24/45] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:47 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:47.765453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-32067976", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a12595b-98a5-4f32-a18b-a79716ee46af"}], "security_groups": [{"name": "tempest-securitygroup--1494895804"}], "key_name": "tempest-keypair-134610821", "user_data": "}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:47.806698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6828f4ba-ded6-4b17-9761-08e3c17d46ed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.610526 Jul 28 06:28:47.816608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 22/46] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Jul 28 06:28:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 06:28:47.821943 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4217cb5b-efd3-4ec9-bbfe-3fad2ccaac3d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:47.822560 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4217cb5b-efd3-4ec9-bbfe-3fad2ccaac3d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:47.929851 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4217cb5b-efd3-4ec9-bbfe-3fad2ccaac3d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:47.938085 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] validate_networks() for [('4a12595b-98a5-4f32-a18b-a79716ee46af', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:28:47.957852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4217cb5b-efd3-4ec9-bbfe-3fad2ccaac3d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:47.959480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4217cb5b-efd3-4ec9-bbfe-3fad2ccaac3d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:47.960829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4217cb5b-efd3-4ec9-bbfe-3fad2ccaac3d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1282 microversion: 2.20 time: 0.143045 Jul 28 06:28:47.967496 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:47 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:28:48.024825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:48.034508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:48.061044 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.061535 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.081704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.081704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.081704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=61 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:48.184767 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:48.191990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4c60c2a8-2368-4a69-b974-80c909eeea30 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1246 microversion: 2.1 time: 0.170926 Jul 28 06:28:48.192654 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 24/48] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:48 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1246 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:48.558217 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:48.559538 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:48.567724 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.568382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.569296 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.569898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.608960 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:28:48.609642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:28:48.610476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:28:48.611169 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:28:48.611599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:28:48.624239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.625719 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.627537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.634767 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.659220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:28:48.669583 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for user 0d268e37c8b64bcc9261a80bb0461edc and project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:28:48.679495 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:28:48.682719 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:28:48.771132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:48.778470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-309bbcfb-fe25-48e6-abd8-30a22709bb4b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.224866 Jul 28 06:28:48.779046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 25/49] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:48 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:48.784312 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:48.784913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:48.791012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.791464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.792230 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:48.792664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:48.838026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-66839b74-1ba3-4723-b8e4-1a53f90ecead tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.092400 Jul 28 06:28:48.846095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 25/50] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:28:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:28:48.851725 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3f454f77-55c6-4df4-bfbc-7a9646a601fa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:48.852983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3f454f77-55c6-4df4-bfbc-7a9646a601fa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:48.935506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3f454f77-55c6-4df4-bfbc-7a9646a601fa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:48.946839 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3f454f77-55c6-4df4-bfbc-7a9646a601fa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1235 microversion: 2.1 time: 0.097468 Jul 28 06:28:48.961352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 26/51] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:48 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1235 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:48.990989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e3cb3405-df50-4ac5-87fb-b28be56f183d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:48.991900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e3cb3405-df50-4ac5-87fb-b28be56f183d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:49.182146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e3cb3405-df50-4ac5-87fb-b28be56f183d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:49.196569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e3cb3405-df50-4ac5-87fb-b28be56f183d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:49.198314 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e3cb3405-df50-4ac5-87fb-b28be56f183d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:49.199168 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:49.199644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e3cb3405-df50-4ac5-87fb-b28be56f183d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1282 microversion: 2.20 time: 0.213126 Jul 28 06:28:49.211104 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-62f8942c-b572-4f87-bf21-fc0cb73f2792 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.430951 Jul 28 06:28:49.215220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:48 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:28:49.222498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 26/53] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:48 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:49.222965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:49.223585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:49.229984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:49.230633 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:49.231403 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:49.232590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:49.310309 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:49.316806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-237543ef-ae49-4984-a26d-9847c213a274 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1246 microversion: 2.1 time: 0.100309 Jul 28 06:28:49.317396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 28/54] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:49 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:49.800886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:49.801676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:49.812555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:49.816273 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:49.817524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:49.817983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:49.978758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eae7b0ff-fb9d-483a-acc9-0ef8e6fed57e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:49.980677 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eae7b0ff-fb9d-483a-acc9-0ef8e6fed57e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:50.062197 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eae7b0ff-fb9d-483a-acc9-0ef8e6fed57e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.069640 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eae7b0ff-fb9d-483a-acc9-0ef8e6fed57e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1235 microversion: 2.1 time: 0.098048 Jul 28 06:28:50.070216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 29/55] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:49 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:50.070913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.084260 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-01278ba5-de76-49aa-b74e-080fae00f701 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.287852 Jul 28 06:28:50.086169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 27/56] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:49 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:50.226938 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:50.227546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:50.230568 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:50.234532 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:50.234683 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:50.236401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:50.236564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:50.236688 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:50.236981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:50.242080 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:50.242534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:50.243347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:50.243788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:50.333979 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.342353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.344686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.351229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-22be2776-8f0d-43f5-af68-9f07655a2b42 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1286 microversion: 2.20 time: 0.123026 Jul 28 06:28:50.352033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 30/57] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:50 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:28:50.356873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:50.357509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:50.373593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:50.374282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:50.380303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:50.380303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:50.424333 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.432085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bd0889b8-22ee-443b-8035-76bfab7ce7ae tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.201531 Jul 28 06:28:50.432676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 28/58] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:50 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:50.440838 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:50.448340 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e8bd4275-8757-4809-b16b-39f71c83a24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1238 microversion: 2.1 time: 0.095192 Jul 28 06:28:50.452752 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 31/59] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:50 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:51.095221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:51.095221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:51.103765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.104132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.104901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.105351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.107499 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:51.108188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:51.116947 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.117428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.123305 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.123305 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.226691 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.241873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c6680aa1-1214-4a22-b0e8-d676ec9bed32 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1239 microversion: 2.1 time: 0.155258 Jul 28 06:28:51.244852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 29/60] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:51 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1239 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:51.293374 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.298121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=99 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:51.307394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d97eeaef-eef1-410b-b018-e1d115d81eeb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.204155 Jul 28 06:28:51.308432 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 32/61] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:51 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:51.376875 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:51.377978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:51.384309 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.384960 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.385766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.386220 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.453442 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:51.455166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:51.461669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.462119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.462898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.463336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.479707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.488498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.490876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.495249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0c18923b-c16a-4b3d-ae46-44d26e5d085f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1278 microversion: 2.20 time: 0.119839 Jul 28 06:28:51.497453 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 30/62] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:51 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:28:51.504132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:51.505135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:51.519181 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.523330 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.524257 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:51.524747 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:51.628826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.654625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d37dbd33-46f4-490e-9d58-a733e05179bf tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1238 microversion: 2.1 time: 0.153565 Jul 28 06:28:51.667662 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 31/63] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:51 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1238 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:51.852932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:51.862209 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-04a2b03f-7fd1-4e38-b8cb-aa6806f50f1a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.411280 Jul 28 06:28:51.866398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 33/64] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:51 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:52.280856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:52.280856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:52.280856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.280856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.281825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.281825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.338831 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:52.339869 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:52.348228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.349111 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.349232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:52.350259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.350915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.357565 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-49b988d8-509b-40d7-9d97-8d9e90c052a5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1231 microversion: 2.1 time: 0.097294 Jul 28 06:28:52.370085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 32/65] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:52 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:52.495898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:52.504195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1ac3783a-f46d-47dc-b405-2fecbcd80b30 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.178843 Jul 28 06:28:52.504865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 34/66] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:52 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:52.520976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:52.521621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:52.528569 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.529012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.530264 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.530714 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.601150 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:52.610658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:52.612367 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:52.613546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c7c53532-441d-462b-8b50-5eb0542533c9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1334 microversion: 2.20 time: 0.097879 Jul 28 06:28:52.614191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:52 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:28:52.675276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:52.676202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:52.682734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.683595 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.684591 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.685244 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.762975 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:52.772221 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9f4f91dd-2165-44db-bec9-d4033d09eb49 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1294 microversion: 2.1 time: 0.101087 Jul 28 06:28:52.773408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 35/68] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:52 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:52.884739 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:52.885372 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:52.892484 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.892985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:52.893784 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:52.894224 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.050073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.059380 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-46f08231-1dbb-4f61-aaaf-a385a61802c4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.178432 Jul 28 06:28:53.060400 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 34/69] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:52 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:53.379772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:53.380392 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:53.386838 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.387440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.388229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.388841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.453727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.461154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6aa05edc-1b3a-49a9-9f11-8ba262c246d8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1287 microversion: 2.1 time: 0.085292 Jul 28 06:28:53.461757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 36/70] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:53 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:53.534473 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:53.535109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:53.541515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.541975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.542757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.543200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.636469 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:53.641661 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:53.645433 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.647459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.648555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.649152 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.742328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.762394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.764072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.765362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9cab4c46-7a03-4158-859e-ae6ebdec046a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1334 microversion: 2.20 time: 0.132861 Jul 28 06:28:53.766708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 37/71] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:53 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:28:53.797693 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.800423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:53.801538 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:53.808105 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d6e6b78a-7573-4690-90e3-10f5ca25c6c8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.281098 Jul 28 06:28:53.809825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 35/72] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:53 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:53.812090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.812553 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.814225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:53.814663 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:53.884075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:53.892946 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-69292da1-034f-4093-b638-4c507e9e25b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1302 microversion: 2.1 time: 0.101627 Jul 28 06:28:53.893720 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 38/73] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:53 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:54.081422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:54.082205 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:54.089517 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.089976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.091057 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.091640 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.271306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:54.282668 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-11650ebb-3736-4ddc-bac1-795b7159893b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.204832 Jul 28 06:28:54.283686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 36/74] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:54 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:54.483878 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:54.484542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:54.497613 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.498247 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.499173 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.501068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.620653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:54.652263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1b9ebb6e-3a07-45e0-bc33-36343764c5ce tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1287 microversion: 2.1 time: 0.173237 Jul 28 06:28:54.652864 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 39/75] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:54 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:54.789297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:54.790552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:54.805819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.809464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.811783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.813872 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.827069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:54.828128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:54.839068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.839518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:54.840309 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:54.849416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:55.293931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:55.303991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:55.308709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:55.314857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8ee6ffe3-9161-4941-9e23-5ba3cfbe2233 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1342 microversion: 2.20 time: 0.524252 Jul 28 06:28:55.327230 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 37/76] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:54 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1342 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:28:55.337367 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:55.338185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:55.345086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:55.345786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:55.346813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:55.347401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:55.523644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:55.533879 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fdc2e6b3-7833-4f25-ac46-1057bd476bcd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.710486 Jul 28 06:28:55.536159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 40/77] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:54 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:55.564159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:55.564159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:55.566763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:55.567224 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:55.568015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:55.568459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:55.974471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:55.983406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:55.994253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b3252877-d45e-411e-b1be-8bb3d034f261 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.455461 Jul 28 06:28:55.994838 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 41/78] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:55 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:55.998023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-03c769f5-c8f8-4fe6-a0f8-f6eb9b8bfce2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.669342 Jul 28 06:28:56.014888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 38/79] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:55 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:56.025369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:56.025993 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:56.036671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.037323 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:56.038738 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.039336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:56.163938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:56.173076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ddfe1adb-4edb-427c-8213-9e6ac657d0f5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1293 microversion: 2.1 time: 0.155371 Jul 28 06:28:56.174192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 39/80] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:56 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:56.223871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-f9d6c1cb-d5eb-475d-97e4-315bed05ef26 req-45b86619-6c6a-4af0-9f5f-9d4e096e3946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d8c679-5516-46fb-a7e5-f9f46d2c17f6", "name": "network-vif-plugged", "status": "completed", "tag": "a47764d3-1a16-4912-b7f4-99264deba837"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:56.235250 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-f9d6c1cb-d5eb-475d-97e4-315bed05ef26 req-45b86619-6c6a-4af0-9f5f-9d4e096e3946 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.235912 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-f9d6c1cb-d5eb-475d-97e4-315bed05ef26 req-45b86619-6c6a-4af0-9f5f-9d4e096e3946 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:56.252460 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-f9d6c1cb-d5eb-475d-97e4-315bed05ef26 req-45b86619-6c6a-4af0-9f5f-9d4e096e3946 service nova] Creating event network-vif-plugged:a47764d3-1a16-4912-b7f4-99264deba837 for instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 on hv-cinder-81242 Jul 28 06:28:56.260875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-f9d6c1cb-d5eb-475d-97e4-315bed05ef26 req-45b86619-6c6a-4af0-9f5f-9d4e096e3946 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246774 Jul 28 06:28:56.261926 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 42/81] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:56.346716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:56.347631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:56.359486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.361255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:56.362551 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.363413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:56.479451 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:56.491698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:56.510721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:56.514579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:56.515592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-812f7839-2a27-49d3-9cb1-63dce6e96873 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1340 microversion: 2.20 time: 0.178286 Jul 28 06:28:56.517504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 40/82] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:56 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1340 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:28:56.560126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:56.566799 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:56.574601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.575144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:56.579334 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:56.583614 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.020828 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:57.022952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:57.034584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.034969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.035753 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.036193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.340848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:57.358758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-64a7dd22-24e4-4066-968e-a017ac39c2ee tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.804277 Jul 28 06:28:57.381660 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 43/83] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:56 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:57.419783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:57.420419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:57.443696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.443696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.443696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.443696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.577926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:57.684253 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:57.702596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-35aee503-fbd0-47fe-af58-15d38c3bfbf4 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.687254 Jul 28 06:28:57.710723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 41/84] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:57 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:28:57.720443 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-d66fe493-92f9-49b4-aed6-ff18429f5bc1 req-1ed7e6b9-dfa4-46a8-8d03-60a02a0dbb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b394488f-cd75-46c4-b399-909d7bd808fa", "tag": "f73695a0-ec1f-4387-94ac-3d3ad1c57c48"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:57.734102 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d66fe493-92f9-49b4-aed6-ff18429f5bc1 req-1ed7e6b9-dfa4-46a8-8d03-60a02a0dbb43 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.735680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d66fe493-92f9-49b4-aed6-ff18429f5bc1 req-1ed7e6b9-dfa4-46a8-8d03-60a02a0dbb43 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.760036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-d66fe493-92f9-49b4-aed6-ff18429f5bc1 req-1ed7e6b9-dfa4-46a8-8d03-60a02a0dbb43 service nova] Creating event network-changed:f73695a0-ec1f-4387-94ac-3d3ad1c57c48 for instance b394488f-cd75-46c4-b399-909d7bd808fa on hv-cinder-81242 Jul 28 06:28:57.774079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-d66fe493-92f9-49b4-aed6-ff18429f5bc1 req-1ed7e6b9-dfa4-46a8-8d03-60a02a0dbb43 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057063 Jul 28 06:28:57.775897 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 42/85] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:57.793667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:57.795963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:57.809706 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.810679 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.811821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.813987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.949497 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=14 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:57.961122 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:57.970253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ac278c60-6bc1-40b6-a235-7c0836921e2d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.582519 Jul 28 06:28:57.970829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 44/86] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:57 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:57.975464 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:57.976238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:57.982403 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.983040 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:57.983993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:57.985150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:58.582949 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:58.594603 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9367c954-890e-42c0-87a2-41c87454f047 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.812961 Jul 28 06:28:58.595351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 43/87] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:57 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:58.620769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-feb3d476-e338-4e96-836e-3c8ce8c1f491 req-f1e160e1-f3ab-4d72-bc2b-5acdb9b489d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304ff8e1-a50f-4e7e-a0df-39476ea30e25", "name": "network-vif-plugged", "status": "completed", "tag": "2820efb3-8d20-487d-8462-76666e80919c"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:28:58.629383 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-feb3d476-e338-4e96-836e-3c8ce8c1f491 req-f1e160e1-f3ab-4d72-bc2b-5acdb9b489d0 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:58.631041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-feb3d476-e338-4e96-836e-3c8ce8c1f491 req-f1e160e1-f3ab-4d72-bc2b-5acdb9b489d0 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:58.643400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:28:58.655903 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-feb3d476-e338-4e96-836e-3c8ce8c1f491 req-f1e160e1-f3ab-4d72-bc2b-5acdb9b489d0 service nova] Creating event network-vif-plugged:2820efb3-8d20-487d-8462-76666e80919c for instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 on hv-cinder-81242 Jul 28 06:28:58.669116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:58.685032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-feb3d476-e338-4e96-836e-3c8ce8c1f491 req-f1e160e1-f3ab-4d72-bc2b-5acdb9b489d0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076464 Jul 28 06:28:58.686973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 44/88] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:28:58.688768 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:58.691103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:58.697811 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-83e30fb9-381b-4ba3-a6c5-3cc721f510a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.724140 Jul 28 06:28:58.700515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 45/89] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:57 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:28:58.703909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:58.706023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:58.714255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:58.714707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:58.716320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:58.716908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:58.727736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:58.728360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:58.764582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:58.770692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:58.773411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:58.774098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:59.213653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:59.230085 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2cf22760-9beb-4f17-9081-4a95453fddcd tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.507950 Jul 28 06:28:59.232236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 46/90] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:58 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:59.248003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:59.249140 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:59.276054 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:59.279085 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:59.297782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:59.297782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:59.348878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:59.366020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-632b89c5-9ee3-481a-a157-6365f4410ec7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.673733 Jul 28 06:28:59.368208 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 45/91] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:58 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:59.621230 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:59.625323 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:59.642061 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:59.642807 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:59.643679 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:59.644198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:59.754604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:28:59.764134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3562fa88-725e-4437-82eb-25df280c9df7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.529375 Jul 28 06:28:59.764796 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 47/92] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:59 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:28:59.769844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:28:59.770705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:28:59.777936 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:59.778618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:28:59.779569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:28:59.780388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.068704 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=16 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:00.122731 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.131655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5eaad5f0-01bc-4eef-aeff-25cd4596dcb4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.515656 Jul 28 06:29:00.132247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 46/93] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:28:59 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:00.137461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-757ce921-979e-4332-9e46-4993206acdd7 req-f367a2dc-a8d5-4ee1-966f-66d2ef516d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:00.157757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-757ce921-979e-4332-9e46-4993206acdd7 req-f367a2dc-a8d5-4ee1-966f-66d2ef516d62 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.158336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-757ce921-979e-4332-9e46-4993206acdd7 req-f367a2dc-a8d5-4ee1-966f-66d2ef516d62 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.200615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-757ce921-979e-4332-9e46-4993206acdd7 req-f367a2dc-a8d5-4ee1-966f-66d2ef516d62 service nova] Creating event network-changed:0d2efce0-28f9-47ea-a49a-15a80e72550a for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e on hv-cinder-81242 Jul 28 06:29:00.207399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-757ce921-979e-4332-9e46-4993206acdd7 req-f367a2dc-a8d5-4ee1-966f-66d2ef516d62 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073872 Jul 28 06:29:00.208393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 47/94] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:00.214816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.230093 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.231609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.233101 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0b19316c-de4d-44fe-bdff-124d78e46c43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.467838 Jul 28 06:29:00.233614 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 48/95] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:28:59 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:00.257186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:00.258164 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:00.266329 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.267052 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.268008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.268457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.387157 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:00.388120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:00.397686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.401720 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.402644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.404287 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.615777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.623587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-07d7c384-cffb-4f2c-8ee2-1850504a32f1 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1313 microversion: 2.1 time: 0.371038 Jul 28 06:29:00.625381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 48/96] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:00 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:00.660308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.668038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9120a8a4-aed4-4264-917c-d3770c4516ab tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.284896 Jul 28 06:29:00.668619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 49/97] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:00 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:00.707336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-d8bdffa7-1720-4472-ba52-23299eb5cc00 req-4ddbf06a-4640-4c13-aa51-33235bcb4b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cca25c-8de5-474c-894c-13860e7f2146", "name": "network-vif-plugged", "status": "completed", "tag": "311a1ab8-32bf-407e-8d50-784a681fe39e"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:00.716815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d8bdffa7-1720-4472-ba52-23299eb5cc00 req-4ddbf06a-4640-4c13-aa51-33235bcb4b91 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.717551 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d8bdffa7-1720-4472-ba52-23299eb5cc00 req-4ddbf06a-4640-4c13-aa51-33235bcb4b91 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.730312 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-d8bdffa7-1720-4472-ba52-23299eb5cc00 req-4ddbf06a-4640-4c13-aa51-33235bcb4b91 service nova] Creating event network-vif-plugged:311a1ab8-32bf-407e-8d50-784a681fe39e for instance c5cca25c-8de5-474c-894c-13860e7f2146 on hv-cinder-81242 Jul 28 06:29:00.735469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-d8bdffa7-1720-4472-ba52-23299eb5cc00 req-4ddbf06a-4640-4c13-aa51-33235bcb4b91 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032244 Jul 28 06:29:00.736065 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 49/98] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:00.790093 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:00.791006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:00.798460 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.799132 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.800143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:00.800783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:00.825555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:00.977575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:00.985987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9c9f8fca-5083-4d5a-9856-b6fd1c9b133e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.201704 Jul 28 06:29:00.986632 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 50/99] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:00 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:01.154327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:01.156026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:01.174588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.175258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.176259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.176892 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.262662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:01.264026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:01.274139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.277300 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.281840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.281840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.584070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:01.598627 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a0e4bf5b-93c5-4632-a56d-1307f8dab116 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.448703 Jul 28 06:29:01.600889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 50/100] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:01 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:01.646884 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:01.647580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:01.660254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.661377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.662487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.663074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.683654 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:01.694398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:01.707043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:01.708475 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e97121b4-8879-41d3-834e-4316b56c3807 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.450654 Jul 28 06:29:01.709562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 51/101] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:01 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:29:01.714310 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:01.718038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:01.731536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.732238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:01.733196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:01.733813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.002169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.004842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.010219 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cbaac25d-bea4-4f4a-bc66-0d92d88433bf tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1499 microversion: 2.1 time: 0.368409 Jul 28 06:29:02.011047 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 51/102] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:01 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1499 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:02.013080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9df1e072-e167-4405-b36b-82def104b488 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.302140 Jul 28 06:29:02.015051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 52/103] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:01 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:02.016132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:02.016735 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:02.022865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.023319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.024089 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.024530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.182304 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.199969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c9459965-257a-4c3c-8039-69867a30f20b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.187816 Jul 28 06:29:02.201071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 52/104] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:02 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:02.240502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-6e77d09f-8dfa-4828-b95c-cb040efc035b req-7d74dd7e-cc52-4cfb-b015-da0830cb68c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b09806-4463-4247-ba82-c87e3362cbd4", "tag": "b21bb56c-34cb-4842-9382-4bf8a79421c4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:02.253167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6e77d09f-8dfa-4828-b95c-cb040efc035b req-7d74dd7e-cc52-4cfb-b015-da0830cb68c2 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.254148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6e77d09f-8dfa-4828-b95c-cb040efc035b req-7d74dd7e-cc52-4cfb-b015-da0830cb68c2 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.268474 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-6e77d09f-8dfa-4828-b95c-cb040efc035b req-7d74dd7e-cc52-4cfb-b015-da0830cb68c2 service nova] Creating event network-changed:b21bb56c-34cb-4842-9382-4bf8a79421c4 for instance c9b09806-4463-4247-ba82-c87e3362cbd4 on hv-cinder-81242 Jul 28 06:29:02.274717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-6e77d09f-8dfa-4828-b95c-cb040efc035b req-7d74dd7e-cc52-4cfb-b015-da0830cb68c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039386 Jul 28 06:29:02.275580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 53/105] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:02.620959 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:02.621522 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:02.628377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.628829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.629627 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.630066 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.755408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:02.757043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:02.769960 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.770956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.772429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:02.772974 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:02.805278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.815751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-89971262-619a-477f-b19a-5f6695cc37f3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.198933 Jul 28 06:29:02.816442 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 53/106] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:02 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:02.926428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.934402 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.935915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:02.937036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4f9ba6dc-bc1d-4e41-b454-52386064dd44 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.208832 Jul 28 06:29:02.938313 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 54/107] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:02 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:03.039620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:03.040325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:03.048193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.048768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.049810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.050952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.223239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:03.223927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:03.230800 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.231249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.232033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.232472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.470368 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:03.477971 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-33f9235d-05c7-4ecc-a42a-b9cd704dec24 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.442383 Jul 28 06:29:03.478557 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 54/108] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:03 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:03.498627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:03.506080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b19ae2a1-7a12-4741-9e38-cf494fe7cac7 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.286898 Jul 28 06:29:03.506645 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 55/109] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:03 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:03.843073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:03.844546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:03.853711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.853711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.853711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.853711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.960911 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:03.961715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:03.969059 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.969789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.970689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:03.971195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:03.994328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:04.001883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6185e35d-938b-487e-b1c8-08636e607d6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.163378 Jul 28 06:29:04.002468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 55/110] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:03 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:04.103541 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:04.112480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:04.114037 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:04.115151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-63deb17f-6e66-4130-b065-324a162ae780 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.158619 Jul 28 06:29:04.115705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 56/111] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:03 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:29:04.499794 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:04.500435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:04.504330 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:04.507927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:04.508449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:04.509215 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:04.509674 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:04.527296 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:04.528576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:04.535992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:04.536495 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:04.537291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:04.538089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:04.899466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:04.934436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:04.949590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-36b87788-b266-4b9b-b4c6-ef636be0339a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.425790 Jul 28 06:29:04.956025 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 57/112] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:04 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:04.956759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fdf82bb8-fe43-4fff-ba8e-d342c834383f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1321 microversion: 2.1 time: 0.435859 Jul 28 06:29:04.956759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 56/113] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:04 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:04.957011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-7d660375-97e0-4648-b135-d17f5cd0918b req-50135cdb-a33c-4cff-b86d-4958d1b85011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b394488f-cd75-46c4-b399-909d7bd808fa", "name": "network-vif-plugged", "status": "completed", "tag": "f73695a0-ec1f-4387-94ac-3d3ad1c57c48"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:04.975687 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-7d660375-97e0-4648-b135-d17f5cd0918b req-50135cdb-a33c-4cff-b86d-4958d1b85011 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:04.977656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-7d660375-97e0-4648-b135-d17f5cd0918b req-50135cdb-a33c-4cff-b86d-4958d1b85011 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:04.991134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-7d660375-97e0-4648-b135-d17f5cd0918b req-50135cdb-a33c-4cff-b86d-4958d1b85011 service nova] Creating event network-vif-plugged:f73695a0-ec1f-4387-94ac-3d3ad1c57c48 for instance b394488f-cd75-46c4-b399-909d7bd808fa on hv-cinder-81242 Jul 28 06:29:04.996201 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-7d660375-97e0-4648-b135-d17f5cd0918b req-50135cdb-a33c-4cff-b86d-4958d1b85011 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044085 Jul 28 06:29:04.997352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 58/114] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:05.026173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:05.027147 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:05.029318 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8986180b-794b-472c-a050-59f1046ffac9"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:05.032106 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:05.041590 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:05.042165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:05.043567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:05.044238 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:05.046332 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:05.046792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:05.048740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:05.049858 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:05.438055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:05.460439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-42278b26-2972-43a1-a620-ee057ceabde6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.440966 Jul 28 06:29:05.461817 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 57/115] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:05 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:05.480087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:05.481295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:05.491898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:05.492509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:05.494449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:05.494449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:05.638829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:05.652718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:05.654279 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:05.655405 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-eefc2514-8a1e-42f1-b6b0-b97e3da359f3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.192571 Jul 28 06:29:05.669667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 58/116] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:05 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:05.669667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1231842234", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "networks": [{"uuid": "8974bd1f-ab5c-4284-a68b-b8398f038e53"}]}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:05.718148 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] validate_networks() for [('8974bd1f-ab5c-4284-a68b-b8398f038e53', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:29:06.109683 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:29:06.110859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:29:06.111377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:29:06.111789 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:29:06.112233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:29:06.121870 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.122321 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.123232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.123670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.147105 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Getting quotas for project 22a64b6b084848ec89599880170c719e. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:29:06.148468 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0b324169-63a9-4531-aca2-54e85802ccf9 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "POST /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.123955 Jul 28 06:29:06.151373 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Getting quotas for user eb2a7c1097e0421492e8460e9b64a27b and project 22a64b6b084848ec89599880170c719e. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:29:06.162943 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 59/117] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:29:05 2022] POST /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6/os-volume_attachments => generated 194 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:29:06.163511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:29:06.170166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:29:06.170274 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:06.170274 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:06.176929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.177638 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.178564 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.178996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.316678 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d2a039a1-74dd-4fae-8485-55ad2b528a5d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659654 Jul 28 06:29:06.317377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 59/118] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:29:06.330639 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:06.332165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:06.339055 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.342442 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.343081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.345592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.346393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.357021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6dc004e8-e5ed-4e95-9e7a-d2fa2e210fee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.192186 Jul 28 06:29:06.358114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 60/119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:06 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:06.364307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ff3ccd37-a27c-4a71-accf-01dabd541a13 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:06.365385 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ff3ccd37-a27c-4a71-accf-01dabd541a13 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:06.458238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ff3ccd37-a27c-4a71-accf-01dabd541a13 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.468812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ff3ccd37-a27c-4a71-accf-01dabd541a13 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1214 microversion: 2.1 time: 0.108921 Jul 28 06:29:06.470765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 61/120] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:06 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:06.483754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:06.487909 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:06.493327 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.494106 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.495080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.495782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.558746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.561497 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:06.581816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1d71d50a-ca61-4484-b62d-fc7d4a617774 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1515 microversion: 2.1 time: 0.250899 Jul 28 06:29:06.581816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 60/121] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:06 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:06.601513 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:06.604100 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:06.635211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.635705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.636507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.636946 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.727536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.736603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c16c3dc9-8f58-434f-b9a2-4f342670a02c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.257218 Jul 28 06:29:06.737840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 62/122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:06 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:06.743581 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:06.744363 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:06.758053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lazy-loading 'flavor' on Instance uuid c5cca25c-8de5-474c-894c-13860e7f2146 {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:29:06.759195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.774702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.775936 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:06.776396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:06.933404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.942931 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.944480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:06.945633 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7d505a60-93f7-4aa3-974e-58810e767828 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.206385 Jul 28 06:29:06.946185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 63/123] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:06 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:07.141512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7183ab0d-8e3e-4ef7-803e-eb20c6144f72 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146/action" status: 200 len: 32 microversion: 2.1 time: 0.549130 Jul 28 06:29:07.142823 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 61/124] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:29:06 2022] POST /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146/action => generated 32 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:29:07.154772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:07.155813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:07.166001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.166780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.169124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.169786 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.345963 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:07.353676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ec51ca49-b276-4d70-a93a-cd14325fcd79 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.205129 Jul 28 06:29:07.354257 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 64/125] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:07 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:07.380672 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:07.381581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:07.390050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.390503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.391990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.392436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.505046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a22e79f4-81a9-4bdb-8b3e-dea359bb8e83 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:07.505046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a22e79f4-81a9-4bdb-8b3e-dea359bb8e83 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:07.641987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a22e79f4-81a9-4bdb-8b3e-dea359bb8e83 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:07.648874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a22e79f4-81a9-4bdb-8b3e-dea359bb8e83 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1214 microversion: 2.1 time: 0.160887 Jul 28 06:29:07.649470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 65/126] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:07 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:07.679374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:07.687114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-76ff2881-234f-47e9-a781-2d3d3f02f275 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.311683 Jul 28 06:29:07.687703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 62/127] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:07 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:07.759346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:07.760075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:07.766733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.767395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.768272 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.772627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.974052 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:07.975909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:07.986153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.989524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:07.990733 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:07.992963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.124725 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:08.133964 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b32831c3-b566-4f56-bbd0-152f4535fd8c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.378453 Jul 28 06:29:08.148139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 66/128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:07 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:08.180132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:08.189354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:08.190886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:08.192013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a84675bc-63b8-4568-b596-562275eb2d73 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.222879 Jul 28 06:29:08.192582 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 63/129] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:07 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:08.384559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:08.385260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:08.392465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.392989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.393899 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.394397 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.541217 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:08.549341 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6752d276-e034-4ea6-9935-583e82a4a664 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.172661 Jul 28 06:29:08.550147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 67/130] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:08 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:08.669698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:08.670477 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:08.677675 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.678471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.682487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.682487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.720580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:08.721483 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:08.741846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.742337 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.743123 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.745725 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.769866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:08.782812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1360fea9-b436-4617-9f6c-69733c246929 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1210 microversion: 2.1 time: 0.113005 Jul 28 06:29:08.783758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 64/131] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:08 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:08.949262 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-9703f5f3-ada1-4ead-962a-66fc6cf97884 req-be8641e3-6720-4a36-b456-d78242a039d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b09806-4463-4247-ba82-c87e3362cbd4", "name": "network-vif-plugged", "status": "completed", "tag": "b21bb56c-34cb-4842-9382-4bf8a79421c4"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:08.965263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-9703f5f3-ada1-4ead-962a-66fc6cf97884 req-be8641e3-6720-4a36-b456-d78242a039d5 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:08.966096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-9703f5f3-ada1-4ead-962a-66fc6cf97884 req-be8641e3-6720-4a36-b456-d78242a039d5 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:08.988856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-9703f5f3-ada1-4ead-962a-66fc6cf97884 req-be8641e3-6720-4a36-b456-d78242a039d5 service nova] Creating event network-vif-plugged:b21bb56c-34cb-4842-9382-4bf8a79421c4 for instance c9b09806-4463-4247-ba82-c87e3362cbd4 on hv-cinder-81242 Jul 28 06:29:09.001633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-9703f5f3-ada1-4ead-962a-66fc6cf97884 req-be8641e3-6720-4a36-b456-d78242a039d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058296 Jul 28 06:29:09.002887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 65/132] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:29:09.155983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:09.157680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:09.169275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.173765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.174774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.176419 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.196644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.202575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:09.205629 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-72bc85ab-d00b-4d35-a8b9-e59e1ee8f30e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1367 microversion: 2.1 time: 0.498595 Jul 28 06:29:09.216074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 68/133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:08 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1367 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:09.221923 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:09.222741 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:09.231588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.233962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.233962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.233962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.386941 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.398838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8d979446-c32b-4593-83ab-750ffaea77fe tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.247004 Jul 28 06:29:09.400143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 66/134] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:09 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:09.432349 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.441638 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.443544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.444679 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-12d62d3f-40d4-4961-b494-35ddb4309fb9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.227051 Jul 28 06:29:09.445246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 69/135] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:09 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:09.571699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:09.572335 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:09.580394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.580836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.581664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.582093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.724360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.733474 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-eaa3a958-c2af-4b3b-a3a1-2a2c4debe9c6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.166223 Jul 28 06:29:09.750124 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 67/136] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:09 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:09.804190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:09.805587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:09.815897 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.816610 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.817421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:09.817858 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:09.887500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:09.901441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-69973b64-6e9d-48eb-a481-67796e2f4c64 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1210 microversion: 2.1 time: 0.100904 Jul 28 06:29:09.902136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 70/137] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:09 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:10.229415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:10.230184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:10.237503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.242353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.242353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.242353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.410354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:10.417854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-adc4d86c-cb2f-4e5d-b9f1-993bf39050bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1558 microversion: 2.1 time: 0.193000 Jul 28 06:29:10.419138 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 68/138] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:10 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:10.419942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:10.420559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:10.427675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.428132 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.428898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.429359 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.439153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:10.439647 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:10.445727 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.446178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.448636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.448636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.588204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-65e68695-ec6d-49ba-b000-f9aa8e3a97ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153101 Jul 28 06:29:10.588810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 69/139] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:29:10 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:29:10.593704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:10.594425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:10.607660 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.609976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.610938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.613375 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.769299 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:10.779702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-628897d1-d034-4edb-a15b-41a6f8f85e59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.363365 Jul 28 06:29:10.793620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 71/140] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:10 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:10.806704 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:10.809856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:10.825976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.826739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:10.830240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:10.833342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:11.006143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:11.018304 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:11.019812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:11.020944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-74df0408-9fcb-46b1-b5a0-c5d7e08021e7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.431184 Jul 28 06:29:11.029764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 70/141] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:10 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:11.039095 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:11.039707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:11.061488 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:11.062306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:11.065889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:11.071046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:11.150049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:11.167291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1d0014e2-4a54-4424-9bb7-2d78e38852f2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.377574 Jul 28 06:29:11.171557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 72/142] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:10 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:11.180903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-ce51441c-7477-4f3b-8997-4c48a91d88d5 req-d8c5f789-ca2d-47c4-a4f1-6c506e69aa22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "name": "network-vif-plugged", "status": "completed", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:11.192725 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ce51441c-7477-4f3b-8997-4c48a91d88d5 req-d8c5f789-ca2d-47c4-a4f1-6c506e69aa22 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:11.193012 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ce51441c-7477-4f3b-8997-4c48a91d88d5 req-d8c5f789-ca2d-47c4-a4f1-6c506e69aa22 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:11.245825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-ce51441c-7477-4f3b-8997-4c48a91d88d5 req-d8c5f789-ca2d-47c4-a4f1-6c506e69aa22 service nova] Creating event network-vif-plugged:0d2efce0-28f9-47ea-a49a-15a80e72550a for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e on hv-cinder-81242 Jul 28 06:29:11.260667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-ce51441c-7477-4f3b-8997-4c48a91d88d5 req-d8c5f789-ca2d-47c4-a4f1-6c506e69aa22 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083314 Jul 28 06:29:11.261279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 73/143] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:11.316019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:11.326241 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-326ea63f-5c89-4223-9240-0cd74d2865f3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1210 microversion: 2.1 time: 0.295309 Jul 28 06:29:11.327595 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 71/144] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:11 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1210 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:11.802077 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:11.802789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:11.810210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:11.811590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:11.812927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:11.813757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.052655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:12.054562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:12.071133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.071688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.073219 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.074222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.080146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:12.089350 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-280f4598-dac8-4232-b566-eee7b2e45296 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.291643 Jul 28 06:29:12.104044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 74/145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:11 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:12.196186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:12.197159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:12.210045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.210502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.211421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.211886 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.381421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:12.408814 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:12.411447 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:12.412633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4e54232a-fea9-4e0f-9b28-e5cc2d85af1c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.363989 Jul 28 06:29:12.413730 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 72/146] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:12 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:29:12.435813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:12.436799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:12.444514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.445196 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.446219 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.446811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.547724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:12.555736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3946a54f-1723-4abe-9775-fb9c67e0ef21 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.366917 Jul 28 06:29:12.556320 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 75/147] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:12 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:12.560450 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:12.576349 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3716ed32-994b-496f-bf66-34645a64f9ba tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1266 microversion: 2.1 time: 0.144987 Jul 28 06:29:12.576975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 73/148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:12 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:12.655934 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-3d1deecc-f689-4cdd-84d9-c0d71747ad2a req-91be3db8-e94f-4448-8f17-6d97b38aebbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b394488f-cd75-46c4-b399-909d7bd808fa", "tag": "f73695a0-ec1f-4387-94ac-3d3ad1c57c48"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:12.679781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3d1deecc-f689-4cdd-84d9-c0d71747ad2a req-91be3db8-e94f-4448-8f17-6d97b38aebbf service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.680245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3d1deecc-f689-4cdd-84d9-c0d71747ad2a req-91be3db8-e94f-4448-8f17-6d97b38aebbf service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.695955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-3d1deecc-f689-4cdd-84d9-c0d71747ad2a req-91be3db8-e94f-4448-8f17-6d97b38aebbf service nova] Creating event network-changed:f73695a0-ec1f-4387-94ac-3d3ad1c57c48 for instance b394488f-cd75-46c4-b399-909d7bd808fa on hv-cinder-81242 Jul 28 06:29:12.702464 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-3d1deecc-f689-4cdd-84d9-c0d71747ad2a req-91be3db8-e94f-4448-8f17-6d97b38aebbf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051462 Jul 28 06:29:12.713593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 76/149] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:29:12.808585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:12.809087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:12.816763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.817597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.819237 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:12.819677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:12.885581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:29:13.082570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:13.114656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:13.116682 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:13.134470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.134919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.145550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.148925 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.279892 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-31a32a34-72df-40b5-80e4-d14a097c11a5 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "DELETE /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 204 len: 0 microversion: 2.1 time: 0.479001 Jul 28 06:29:13.280443 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 74/150] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:29:12 2022] DELETE /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:29:13.292244 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:13.293750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:13.311699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.314860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.316891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.318567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.546654 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:13.561074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3c81a3c4-c46d-48f3-b345-50cc17f55608 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1361 microversion: 2.1 time: 0.451826 Jul 28 06:29:13.561782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 77/151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:13 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:13.568999 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:13.569857 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:13.576166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:13.587072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.587710 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.588758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.592447 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.598432 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:13.610826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e7188e0d-216e-426f-b43e-e7de1cf6a203 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1551 microversion: 2.1 time: 0.324455 Jul 28 06:29:13.617966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 75/152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:13 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1551 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:13.625021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:13.626455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:13.633514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.633957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.634863 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:13.635296 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:13.962307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:13.975327 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:13.975442 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:13.976490 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:13.978208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b5045319-1318-4d28-bebf-62df79ae7537 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.414519 Jul 28 06:29:13.979051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 78/153] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:13 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:13.983844 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0c58259f-f151-4de9-8d33-3af677aecafb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.369571 Jul 28 06:29:13.985159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:13.986194 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:13.986864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 76/154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:13 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:14.000949 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.001643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.004136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.004659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.113742 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:14.129039 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f8a0029b-5404-4acc-b3ee-feaa3d0ae7a1 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1284 microversion: 2.1 time: 0.147093 Jul 28 06:29:14.129733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 79/155] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:13 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:14.583025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:14.584011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:14.592265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.593343 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.595110 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.595745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.636297 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:14.636865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:14.643931 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.644366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.645329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.645915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.807493 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:14.816045 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-531ed9fd-7fba-4a5c-9ba3-eba794a2f6d2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1547 microversion: 2.1 time: 0.238259 Jul 28 06:29:14.831701 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 77/156] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:14 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1547 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:14.838833 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:14.839709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:14.848049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.848848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.849889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:14.850516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:14.858414 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:14.869433 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0182218c-5072-4378-b683-3e6ae575056a tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1551 microversion: 2.1 time: 0.237095 Jul 28 06:29:14.870347 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 80/157] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:14 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1551 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:14.957622 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-34b3ee6f-24cc-44ed-aeaf-b8e30cd68cb6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122833 Jul 28 06:29:14.958478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 78/158] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:29:14 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:29:15.002508 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:15.003113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:15.009856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.010297 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.011067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.011498 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.012128 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:15.012923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:15.020239 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.020969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.021919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.022429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.439917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:15.448156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-92ea5d23-cd4b-490c-ab5e-c810fe230bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.441888 Jul 28 06:29:15.449034 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 79/159] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:15 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:15.462224 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:15.469461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:15.469942 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:15.471122 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:15.472881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:15.474580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b0c25036-ee21-445a-9668-101e023264de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.476109 Jul 28 06:29:15.475134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 81/160] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:14 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:29:15.483082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.485584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.486376 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.487008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.638928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:15.649268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3f7ade02-ebfd-41e2-a6ef-5277dba894b4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1326 microversion: 2.1 time: 0.185316 Jul 28 06:29:15.662160 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 80/161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:15 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1326 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:15.891118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:15.891984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:15.898986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.899441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:15.900209 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:15.900706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.057888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:16.079069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0d55ccda-457d-442f-9f0a-e4ff1b2943d3 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1551 microversion: 2.1 time: 0.191557 Jul 28 06:29:16.079694 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 82/162] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:15 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1551 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:16.401275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:16.401880 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:16.408480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-e4360a66-c651-4460-a0b1-1a6f91131258 req-8c373dbe-eeed-4dba-b4db-d0dc700b309b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b09806-4463-4247-ba82-c87e3362cbd4", "tag": "b21bb56c-34cb-4842-9382-4bf8a79421c4"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:16.418428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-e4360a66-c651-4460-a0b1-1a6f91131258 req-8c373dbe-eeed-4dba-b4db-d0dc700b309b service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.420302 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-e4360a66-c651-4460-a0b1-1a6f91131258 req-8c373dbe-eeed-4dba-b4db-d0dc700b309b service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.439237 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-e4360a66-c651-4460-a0b1-1a6f91131258 req-8c373dbe-eeed-4dba-b4db-d0dc700b309b service nova] Creating event network-changed:b21bb56c-34cb-4842-9382-4bf8a79421c4 for instance c9b09806-4463-4247-ba82-c87e3362cbd4 on hv-cinder-81242 Jul 28 06:29:16.447202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-e4360a66-c651-4460-a0b1-1a6f91131258 req-8c373dbe-eeed-4dba-b4db-d0dc700b309b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048126 Jul 28 06:29:16.448095 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 81/163] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:16.470927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:16.471549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:16.479116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.479576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.480352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.480797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.502339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:16.503443 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:16.511663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.512252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.513585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.514149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.711783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:16.720347 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c6567e42-848b-404a-8d6f-45e875f04f13 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.254109 Jul 28 06:29:16.721023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 83/164] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:16 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:16.732180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:16.732891 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:16.739226 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.739671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.740437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:16.740893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:16.770255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:16.782266 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:16.784067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:16.786018 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3451c716-9952-4158-846f-842c4c5094f7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1407 microversion: 2.20 time: 0.291155 Jul 28 06:29:16.803758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 82/165] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:16 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:29:17.101284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:17.102667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:17.114813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:17.115597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:17.116299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:17.117395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:17.119013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:17.123400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-28efe5b7-f7b9-4b82-8de3-7fb967c71a18 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.400170 Jul 28 06:29:17.123400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 84/166] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:16 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:17.593579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:17.603602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e280fa7c-c1ad-4ce9-b4f2-b2581d632971 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1551 microversion: 2.1 time: 0.505965 Jul 28 06:29:17.616449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 83/167] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:17 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1551 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:17.742198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:17.742804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:17.748780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:17.751410 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:17.752091 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:17.753056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:17.753705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:17.811903 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:17.813094 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:17.819833 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:17.826116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:17.826116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:17.826116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:18.311455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:18.322128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cc2b9c3a-35f8-45cb-a5f7-1d92bce3ec26 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.583386 Jul 28 06:29:18.324149 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 85/168] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:17 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:18.330830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-52ea63f6-99c4-4470-a23c-bc0c6e099453 req-f7f48517-35c7-4bbe-ba05-497861c27deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e509d0d8-9a39-4b59-9925-e67579ddc07e", "tag": "1405ad72-631b-4930-84ec-4e411010104f"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:18.346346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-52ea63f6-99c4-4470-a23c-bc0c6e099453 req-f7f48517-35c7-4bbe-ba05-497861c27deb service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:18.347110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-52ea63f6-99c4-4470-a23c-bc0c6e099453 req-f7f48517-35c7-4bbe-ba05-497861c27deb service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:18.364443 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-52ea63f6-99c4-4470-a23c-bc0c6e099453 req-f7f48517-35c7-4bbe-ba05-497861c27deb service nova] Creating event network-changed:1405ad72-631b-4930-84ec-4e411010104f for instance e509d0d8-9a39-4b59-9925-e67579ddc07e on hv-cinder-81242 Jul 28 06:29:18.376634 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-52ea63f6-99c4-4470-a23c-bc0c6e099453 req-f7f48517-35c7-4bbe-ba05-497861c27deb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049010 Jul 28 06:29:18.379223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 86/169] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:18.392366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:18.393435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:18.407573 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:18.407573 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:18.407573 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:18.408005 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:18.432044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:18.558294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:18.568157 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:18.569720 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:18.570976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0dd86c3c-dba2-49f3-b894-0a2f87407d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1599 microversion: 2.20 time: 0.762921 Jul 28 06:29:18.571517 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 84/170] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:29:17 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1599 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:29:18.599126 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:18.619211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:18.619211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:18.619211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:18.619211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:18.619964 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:19.023954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4bbbc748-fc72-4569-b625-6639d3799e7f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.432690 Jul 28 06:29:19.026764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 85/171] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Jul 28 06:29:18 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-interface => generated 285 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:29:19.039221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:19.041550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:19.070006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:19.070006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:19.070006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:19.070006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:19.096837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:19.104660 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e66176c9-afa8-44ac-b2e3-f243353cd9a8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.723845 Jul 28 06:29:19.108624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 87/172] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:18 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:19.119421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-87435fa1-10ad-4e30-8106-9d0c39153687 req-04f08a63-78d1-4721-9f5a-e000701bb0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d8c679-5516-46fb-a7e5-f9f46d2c17f6", "name": "network-vif-deleted", "tag": "a47764d3-1a16-4912-b7f4-99264deba837"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:19.130172 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-87435fa1-10ad-4e30-8106-9d0c39153687 req-04f08a63-78d1-4721-9f5a-e000701bb0ae service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:19.130611 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-87435fa1-10ad-4e30-8106-9d0c39153687 req-04f08a63-78d1-4721-9f5a-e000701bb0ae service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:19.150853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-87435fa1-10ad-4e30-8106-9d0c39153687 req-04f08a63-78d1-4721-9f5a-e000701bb0ae service nova] Creating event network-vif-deleted:a47764d3-1a16-4912-b7f4-99264deba837 for instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 on hv-cinder-81242 Jul 28 06:29:19.157199 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-87435fa1-10ad-4e30-8106-9d0c39153687 req-04f08a63-78d1-4721-9f5a-e000701bb0ae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045854 Jul 28 06:29:19.158343 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 88/173] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:19.267401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:19.273438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-29d4eabb-18b7-4003-b6fa-a7afb461f04b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1509 microversion: 2.1 time: 0.245074 Jul 28 06:29:19.274366 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 86/174] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:19 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:19.348916 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:19.349715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:19.357058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:19.357601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:19.358609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:19.360067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:19.731126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:19.742861 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-11a94a3b-f135-41f4-b944-5b89b4623f00 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.400175 Jul 28 06:29:19.746075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 89/175] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:19 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:20.128926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:20.129622 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:20.135917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.136372 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.137133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.137588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.286187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:20.293933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5fe69ef-54e3-49c6-afdd-df0c4f155b0a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.169016 Jul 28 06:29:20.294505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 87/176] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:20 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:20.296223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:20.298183 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:20.304871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.305753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.306635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.307620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.348251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.348720 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.349170 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lazy-loading 'fault' on Instance uuid 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:29:20.413405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:20.423186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d40b0f23-f712-4f10-b5ef-616a1a55001b tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1514 microversion: 2.1 time: 0.131304 Jul 28 06:29:20.424130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 90/177] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:20 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1514 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:20.771555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:20.772465 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:20.778782 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.779434 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.780375 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:20.781053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:20.918632 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:20.926926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d4225d9d-9f2b-4a1f-9c50-e70e8a86dc2b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.159188 Jul 28 06:29:20.927508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 88/178] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:20 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:21.210009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-1bad8013-dd81-4399-88f7-dec2b5a911f8 req-3256153b-6b8c-431e-a81f-b64cf460707a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:21.223020 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-1bad8013-dd81-4399-88f7-dec2b5a911f8 req-3256153b-6b8c-431e-a81f-b64cf460707a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.225365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-1bad8013-dd81-4399-88f7-dec2b5a911f8 req-3256153b-6b8c-431e-a81f-b64cf460707a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.240746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-1bad8013-dd81-4399-88f7-dec2b5a911f8 req-3256153b-6b8c-431e-a81f-b64cf460707a service nova] Creating event network-changed:0d2efce0-28f9-47ea-a49a-15a80e72550a for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e on hv-cinder-81242 Jul 28 06:29:21.256482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-1bad8013-dd81-4399-88f7-dec2b5a911f8 req-3256153b-6b8c-431e-a81f-b64cf460707a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040690 Jul 28 06:29:21.257122 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 91/179] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:21.317008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:21.322876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:21.328369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.328369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.331654 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.332228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.445207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:21.446206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:21.476874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.477590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.478596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.479234 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.516043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.524685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.525352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lazy-loading 'fault' on Instance uuid 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:29:21.601250 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda0cfe646954a9a8476b346ac9fed72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58565c8c6b5743278fb155d39ed65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:21.614289 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c87e6136-b0b2-45b6-8cf6-83b6a1aecf45 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 200 len: 1514 microversion: 2.1 time: 0.173447 Jul 28 06:29:21.615746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 92/180] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:21 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:21.684235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:21.699556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c2963f0c-d7be-4744-91c3-e9837170e4b5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.386628 Jul 28 06:29:21.700508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 89/181] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:21 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:21.948260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:21.948871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:21.956193 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.956693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:21.957559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:21.958645 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.277902 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:22.291330 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea68705c-fec9-482a-bd7c-55de3930250c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.346930 Jul 28 06:29:22.306047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 93/182] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:21 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:22.648202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:22.648828 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:22.657824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:22.657824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.657824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:22.658067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.674002 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] HTTP exception thrown: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Request method failure captured: Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 HTTP/1.1 Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyBInOimynvn8PBikE8SovpvWhdJrbQmRpKbv-qhIgtv6cl4e2J3JDVFR-1yBlO5YHXUFKLdzbXnLrewfN7PR2jxZgKuZfalyEMTX0Gm-So81Rvd0RGBTWdkiqNyTwoJNCkLR7QHBHkjrIzgRvvfvOrGNgvJ5PLWM10nM-aeK4yug0 Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:29:22.678852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_58565c8c6b5743278fb155d39ed65e3d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}] Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: eda0cfe646954a9a8476b346ac9fed72 Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.680186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': '96d8c679-5516-46fb-a7e5-f9f46d2c17f6'} Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:29:22.680978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.682131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.683131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Returning 404 to user: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:29:22.683131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-80f037f9-5f41-4318-9906-3db1aef75b4c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 404 len: 111 microversion: 2.1 time: 0.036389 Jul 28 06:29:22.683131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 90/183] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:22 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:29:22.721955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:22.722598 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:22.729251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:22.729740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.730533 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:22.730968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.804093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:22.806381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:22.812573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:22.813014 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.813969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:22.816586 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:22.827783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] HTTP exception thrown: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Request method failure captured: Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6/os-volume_attachments HTTP/1.1 Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyBInOimynvn8PBikE8SovpvWhdJrbQmRpKbv-qhIgtv6cl4e2J3JDVFR-1yBlO5YHXUFKLdzbXnLrewfN7PR2jxZgKuZfalyEMTX0Gm-So81Rvd0RGBTWdkiqNyTwoJNCkLR7QHBHkjrIzgRvvfvOrGNgvJ5PLWM10nM-aeK4yug0 Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:29:22.829599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_58565c8c6b5743278fb155d39ed65e3d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}] Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: eda0cfe646954a9a8476b346ac9fed72 Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.830927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'server_id': '96d8c679-5516-46fb-a7e5-f9f46d2c17f6'} Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:29:22.831710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:22.832947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:22.834847 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Returning 404 to user: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:29:22.835734 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-76033839-c541-413f-a0bb-a9ce7b2a7718 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035606 Jul 28 06:29:22.836295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 91/184] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:29:22 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:29:22.879707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:22.889536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d6f46a6c-c582-48fb-94bf-db9beb94a483 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.169848 Jul 28 06:29:22.889536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 94/185] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:22 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:23.317084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:23.317779 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:23.324295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:23.325013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:23.326028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:23.326559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:23.465258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:23.473948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-27a97635-d845-42e0-a4f7-6ad366596b48 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.160939 Jul 28 06:29:23.477819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 92/186] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:23 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:23.910143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:23.910768 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:23.917890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:23.918341 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:23.919120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:23.919560 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.054482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:24.062526 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3d0d4a90-29ef-4b00-854d-643b7dfab063 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.157495 Jul 28 06:29:24.063330 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 95/187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:23 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:24.177749 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:24.178398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:24.185129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:24.185741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.186587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:24.187756 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.201977 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] HTTP exception thrown: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Request method failure captured: Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: DELETE /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 HTTP/1.1 Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyBInOimynvn8PBikE8SovpvWhdJrbQmRpKbv-qhIgtv6cl4e2J3JDVFR-1yBlO5YHXUFKLdzbXnLrewfN7PR2jxZgKuZfalyEMTX0Gm-So81Rvd0RGBTWdkiqNyTwoJNCkLR7QHBHkjrIzgRvvfvOrGNgvJ5PLWM10nM-aeK4yug0 Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:29:24.204306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_58565c8c6b5743278fb155d39ed65e3d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}] Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: eda0cfe646954a9a8476b346ac9fed72 Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.205973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': '96d8c679-5516-46fb-a7e5-f9f46d2c17f6'} Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:29:24.207191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.208533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.210008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Returning 404 to user: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:29:24.210008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3ea3493b-acad-41ae-9895-540bb578a097 tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "DELETE /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 404 len: 111 microversion: 2.1 time: 0.033253 Jul 28 06:29:24.210008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 93/188] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:29:24 2022] DELETE /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:29:24.214898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:24.215512 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] [instance: 96d8c679-5516-46fb-a7e5-f9f46d2c17f6] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:24.222356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:24.222860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.223786 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:24.224223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.238549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] HTTP exception thrown: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Request method failure captured: Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 HTTP/1.1 Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyBInOimynvn8PBikE8SovpvWhdJrbQmRpKbv-qhIgtv6cl4e2J3JDVFR-1yBlO5YHXUFKLdzbXnLrewfN7PR2jxZgKuZfalyEMTX0Gm-So81Rvd0RGBTWdkiqNyTwoJNCkLR7QHBHkjrIzgRvvfvOrGNgvJ5PLWM10nM-aeK4yug0 Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:29:24.243159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_58565c8c6b5743278fb155d39ed65e3d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/58565c8c6b5743278fb155d39ed65e3d"}]}] Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 58565c8c6b5743278fb155d39ed65e3d Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-DeleteServersTestJSON-279889782 Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: eda0cfe646954a9a8476b346ac9fed72 Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-DeleteServersTestJSON-279889782-project Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.244644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '96d8c679-5516-46fb-a7e5-f9f46d2c17f6'} Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:29:24.245501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. Jul 28 06:29:24.246837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:29:24.248117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] Returning 404 to user: Instance 96d8c679-5516-46fb-a7e5-f9f46d2c17f6 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:29:24.248117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ad33080f-72ec-4ec5-af34-f58bc37dc15c tempest-DeleteServersTestJSON-279889782 tempest-DeleteServersTestJSON-279889782-project] 10.222.0.69 "GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6" status: 404 len: 111 microversion: 2.1 time: 0.033949 Jul 28 06:29:24.251056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 96/189] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:24 2022] GET /compute/v2.1/servers/96d8c679-5516-46fb-a7e5-f9f46d2c17f6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:29:24.495984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:24.496594 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:24.503058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:24.503436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.504211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:24.504646 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:24.837356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:24.839884 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:24.847257 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c0b41df7-8345-47b5-b790-0116e11d7560 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.355160 Jul 28 06:29:24.847836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 94/190] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:24 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:25.083488 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:25.084034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:25.091100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:25.091748 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:25.092511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:25.093000 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:25.226780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:25.234438 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b699bd46-a181-4e45-ae3e-ba19f75c41d6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.154890 Jul 28 06:29:25.235013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 97/191] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:25 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:25.869062 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:25.870288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:25.878938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:25.879631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:25.880863 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:25.881484 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:26.026961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:26.035342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bb7f3d21-554b-4185-9904-c61ffe70de08 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.170971 Jul 28 06:29:26.035930 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 95/192] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:25 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:26.256037 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:26.256655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:26.263078 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:26.266691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:26.266691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:26.266691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:26.411499 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:26.420262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c04facb0-186a-42d5-853d-f332918a72d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.168028 Jul 28 06:29:26.421138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 98/193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:26 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:27.056829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:27.058233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:27.061639 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:27.065409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:27.065939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:27.066788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:27.067444 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:27.306927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:27.318485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a7675697-fb8c-4dce-97e8-cd19e580fd03 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.265565 Jul 28 06:29:27.319147 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 96/194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:27 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:27.448370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:27.449278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:27.457708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:27.458358 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:27.459193 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:27.459711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:27.705547 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:27.714080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6d1df11d-c0f8-4059-9120-5ba82c2dda3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.269589 Jul 28 06:29:27.714675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 99/195] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:27 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:28.340893 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:28.342471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:28.360011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:28.360570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:28.361661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:28.363801 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:28.557660 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:28.566502 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-beda7321-9252-45dc-ae59-41b55ad5d846 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.230168 Jul 28 06:29:28.567082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 97/196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:28 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:28.736382 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:28.737692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:28.755705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:28.760421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:28.760421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:28.760421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:28.901331 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:28.910030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea9af4d5-60cb-4489-b030-54ca618348e8 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.177998 Jul 28 06:29:28.910618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 100/197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:28 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:29.574113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-c67d0b78-af8a-4eff-a123-3c17f92e300d req-03c7c4fa-5222-4667-96d0-a3e20aa82024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e509d0d8-9a39-4b59-9925-e67579ddc07e", "name": "network-vif-plugged", "status": "completed", "tag": "1405ad72-631b-4930-84ec-4e411010104f"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:29.585144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c67d0b78-af8a-4eff-a123-3c17f92e300d req-03c7c4fa-5222-4667-96d0-a3e20aa82024 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:29.585745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c67d0b78-af8a-4eff-a123-3c17f92e300d req-03c7c4fa-5222-4667-96d0-a3e20aa82024 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:29.589767 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:29.593445 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:29.599462 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-c67d0b78-af8a-4eff-a123-3c17f92e300d req-03c7c4fa-5222-4667-96d0-a3e20aa82024 service nova] Creating event network-vif-plugged:1405ad72-631b-4930-84ec-4e411010104f for instance e509d0d8-9a39-4b59-9925-e67579ddc07e on hv-cinder-81242 Jul 28 06:29:29.601154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:29.601807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:29.602917 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:29.603529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:29.606785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-c67d0b78-af8a-4eff-a123-3c17f92e300d req-03c7c4fa-5222-4667-96d0-a3e20aa82024 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036188 Jul 28 06:29:29.609725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 98/198] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:29.759972 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:29.767679 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-683d53c7-9b2f-4397-9747-c6a52d8d9c2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.183151 Jul 28 06:29:29.768250 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 101/199] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:29 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:29.932097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:29.932788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:29.939929 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:29.940407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:29.941167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:29.941635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:30.122963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:30.132382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b288a083-6196-4f60-b4ae-33aa6a72120f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.204440 Jul 28 06:29:30.135629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 99/200] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:29 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:30.788825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:30.789601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:30.797637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:30.798381 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:30.799185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:30.799817 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:30.945753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:30.954571 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bf6a1369-2778-4fca-a506-78cf8f717ad6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.169567 Jul 28 06:29:30.955149 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 102/201] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:30 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:31.154383 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:31.156788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:31.163125 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:31.167669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:31.167669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:31.167669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:31.373933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:31.380081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-84985d02-c0e9-4225-a7b3-688adf7fba88 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1314 microversion: 2.1 time: 0.229594 Jul 28 06:29:31.380735 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 100/202] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:31 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:31.976370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:31.977058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:31.983913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:31.984472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:31.985251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:31.985714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:32.132452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:32.144228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-662e748e-0213-4633-98cc-a53a711550c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.171767 Jul 28 06:29:32.144823 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 103/203] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:31 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:32.402458 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:32.403085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:32.410120 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:32.410567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:32.411536 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:32.411978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:32.565587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:32.586722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8c5a7947-5a3b-4379-b125-fa95b2db3474 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1498 microversion: 2.1 time: 0.188411 Jul 28 06:29:32.601411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 101/204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:32 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1498 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:33.175089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:33.176969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:33.185680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:33.187207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:33.189023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:33.190115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:33.335186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:33.344048 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f672b721-3b1f-4766-aa16-f558ef5d4e34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.181411 Jul 28 06:29:33.344626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 104/205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:33 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:33.539975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:33.540879 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:33.548809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:33.549255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:33.550785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:33.550785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:33.577984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:29:33.930123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ade3616d-fca7-40fb-911e-8a011e8821b2 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 204 len: 0 microversion: 2.1 time: 0.394905 Jul 28 06:29:33.931029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 102/206] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:29:33 2022] DELETE /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:29:33.940101 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:33.940727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:33.946819 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:33.947361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:33.948125 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:33.948563 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:33.971419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:34.099647 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:34.107161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c2a7900c-974d-41d6-9b25-9a3d004e4e3c tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1504 microversion: 2.1 time: 0.171692 Jul 28 06:29:34.107740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 105/207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:33 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:34.373164 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:34.373929 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:34.382283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:34.382915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:34.383900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:34.384342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:34.550524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:34.560475 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-25feeead-743f-4fd6-9eae-a7faef5c676e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.193050 Jul 28 06:29:34.561479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 103/208] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:34 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:35.129133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:35.129788 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:35.137380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:35.137926 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:35.138701 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:35.139134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:35.302316 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:35.310215 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c9c23a7b-9d6b-4918-987b-4b1ce32e7343 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1504 microversion: 2.1 time: 0.185013 Jul 28 06:29:35.310802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 106/209] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:35 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:35.584478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:35.585095 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:35.591507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:35.591958 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:35.592778 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:35.593287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:35.761519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:35.773775 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c8f85f5e-3cdd-4e45-8f58-59312bd47411 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.192288 Jul 28 06:29:35.775901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 104/210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:35 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:36.336900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:36.338174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:36.367900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:36.368512 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:36.369739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:36.370665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:36.460003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:36.474239 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-6413ae17-2e21-47d3-a83b-e3022999574b req-0a308803-b7af-4275-85bd-3ee68172e074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e509d0d8-9a39-4b59-9925-e67579ddc07e", "name": "network-vif-deleted", "tag": "1405ad72-631b-4930-84ec-4e411010104f"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:36.474871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9ee1eb90-4c85-4e80-8875-dcd269380ec3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1462 microversion: 2.1 time: 0.145747 Jul 28 06:29:36.475957 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 107/211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:36 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1462 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:36.485656 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-6413ae17-2e21-47d3-a83b-e3022999574b req-0a308803-b7af-4275-85bd-3ee68172e074 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:36.486263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-6413ae17-2e21-47d3-a83b-e3022999574b req-0a308803-b7af-4275-85bd-3ee68172e074 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:36.497365 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-6413ae17-2e21-47d3-a83b-e3022999574b req-0a308803-b7af-4275-85bd-3ee68172e074 service nova] Creating event network-vif-deleted:1405ad72-631b-4930-84ec-4e411010104f for instance e509d0d8-9a39-4b59-9925-e67579ddc07e on hv-cinder-81242 Jul 28 06:29:36.502823 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-6413ae17-2e21-47d3-a83b-e3022999574b req-0a308803-b7af-4275-85bd-3ee68172e074 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Jul 28 06:29:36.503957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 105/212] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:29:36.795027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:36.795700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:36.802703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:36.803147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:36.803916 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:36.804344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:36.950065 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:36.962339 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e228149d-a82d-4693-82f7-a5a0ae2c947c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.171083 Jul 28 06:29:36.965615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 108/213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:36 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:37.497392 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:37.498312 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:37.506414 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:37.507752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:37.508597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:37.509023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:37.546350 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:37.547235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:37.547922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lazy-loading 'fault' on Instance uuid e509d0d8-9a39-4b59-9925-e67579ddc07e {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:29:37.611634 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:37.625612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7e0c075f-56e9-4e4d-aea5-561bbc703739 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 200 len: 1304 microversion: 2.1 time: 0.132720 Jul 28 06:29:37.626485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 106/214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:37 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:37.986308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:37.986918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:37.993978 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:37.994419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:37.995195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:37.995621 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:38.144366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:38.156737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0f4b2955-c475-40a5-a261-c7b0ae581f5c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.174139 Jul 28 06:29:38.158846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 109/215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:37 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:38.647077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:38.647688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: e509d0d8-9a39-4b59-9925-e67579ddc07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:38.653755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:38.654253 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:38.655811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:38.656249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:38.671310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] HTTP exception thrown: Instance e509d0d8-9a39-4b59-9925-e67579ddc07e could not be found. Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Request method failure captured: Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e HTTP/1.1 Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyuYpJys2L5eVSRLBKRaa5Poz8S797zX_YyobS1TicnCS7NgN0UEPXeW-QjDuV6gBXXLBZoswDlHqUIgryly_byRHJdkcuPuQElS1qRUpsAJytWIm0n0q_BmycHa_yo6LgG0uyFYkN7e6HraDcPB26eaOJwJUwUmjYrxKngmjGLL0w Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 22a64b6b084848ec89599880170c719e Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesActionsTest-1879553753 Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:29:38.673041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22a64b6b084848ec89599880170c719e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22a64b6b084848ec89599880170c719e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22a64b6b084848ec89599880170c719e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22a64b6b084848ec89599880170c719e"}]}] Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesActionsTest-1879553753 Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 22a64b6b084848ec89599880170c719e Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesActionsTest-1879553753 Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesActionsTest-1879553753-project Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: eb2a7c1097e0421492e8460e9b64a27b Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesActionsTest-1879553753-project Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance e509d0d8-9a39-4b59-9925-e67579ddc07e could not be found. Jul 28 06:29:38.677461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'e509d0d8-9a39-4b59-9925-e67579ddc07e'} Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e509d0d8-9a39-4b59-9925-e67579ddc07e could not be found. Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:29:38.678141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e509d0d8-9a39-4b59-9925-e67579ddc07e could not be found. Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e509d0d8-9a39-4b59-9925-e67579ddc07e could not be found. Jul 28 06:29:38.679255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:29:38.680216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Returning 404 to user: Instance e509d0d8-9a39-4b59-9925-e67579ddc07e could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:29:38.680216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d4d830e4-2c4c-423a-abd6-15bb650dd81e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e" status: 404 len: 111 microversion: 2.1 time: 0.031337 Jul 28 06:29:38.680216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 107/216] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:38 2022] GET /compute/v2.1/servers/e509d0d8-9a39-4b59-9925-e67579ddc07e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:29:38.811719 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1082636739", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "networks": [{"uuid": "8974bd1f-ab5c-4284-a68b-b8398f038e53"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:38.869148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] validate_networks() for [('8974bd1f-ab5c-4284-a68b-b8398f038e53', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:29:39.191328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:39.193360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:39.202684 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:39.202684 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:39.203165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:39.203606 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:39.503796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:39.511690 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-79928691-0668-4458-8902-5e434bace123 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.327375 Jul 28 06:29:39.512677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 108/217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:39 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:39.544234 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:29:39.544742 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:29:39.545190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:29:39.545649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:29:39.546146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:29:39.557044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:39.557536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:39.558551 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:39.559129 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:39.578420 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Getting quotas for project 22a64b6b084848ec89599880170c719e. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:29:39.582706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Getting quotas for user eb2a7c1097e0421492e8460e9b64a27b and project 22a64b6b084848ec89599880170c719e. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:29:39.594672 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:29:39.596954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:29:39.714030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8890c12f-fdd6-461f-b9e2-5a8d4c771164 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906615 Jul 28 06:29:39.714689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 110/218] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:29:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:29:39.727629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4fc6aa8f-9a81-4f31-b124-775c44816b72 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:39.728494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4fc6aa8f-9a81-4f31-b124-775c44816b72 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:39.807546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4fc6aa8f-9a81-4f31-b124-775c44816b72 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:39.815611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4fc6aa8f-9a81-4f31-b124-775c44816b72 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1214 microversion: 2.1 time: 0.092667 Jul 28 06:29:39.816244 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 109/219] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:39 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:40.535510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:40.536080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:40.542238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:40.542693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:40.543466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:40.543906 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:40.687113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:40.695260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1584c751-f76a-45ba-8331-c03da020c2fc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.164205 Jul 28 06:29:40.696168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 111/220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:40 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:40.837278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:40.838108 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:40.846499 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:40.847327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:40.849137 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:40.852356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:40.919145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:40.926875 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a5f3ba88-0ddf-408b-9025-4c56a88d9f24 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1218 microversion: 2.1 time: 0.093539 Jul 28 06:29:40.927450 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 110/221] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:40 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:41.722315 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:41.724264 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:41.736652 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:41.737682 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:41.739346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:41.740024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:41.948613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:41.950471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:41.960854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:41.962295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:41.963480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:41.963917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:42.001916 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:42.011992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5319256d-236c-4e39-b2ee-f0e381b0b71b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.297084 Jul 28 06:29:42.012586 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 112/222] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:41 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:42.066725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:42.074408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ef653b4f-4246-4469-bdc1-12813cada320 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1284 microversion: 2.1 time: 0.129824 Jul 28 06:29:42.074995 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 111/223] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:41 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:43.034006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:43.035363 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:43.041926 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:43.042373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:43.043174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:43.043603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:43.097839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:43.098605 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:43.105173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:43.105925 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:43.106866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:43.107464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:43.127664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:43.242370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:43.250895 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-febf144f-8aab-4768-893d-a9bc369d119a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.221336 Jul 28 06:29:43.254765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 113/224] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:43 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:43.280362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:43.288136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-215be280-6787-483a-93fb-a3307bc2e7bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.195164 Jul 28 06:29:43.288719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 112/225] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:43 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:44.273950 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:44.274567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:44.277002 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:44.287090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:44.287639 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:44.288643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:44.289221 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:44.315214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:44.315827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:44.322195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:44.322634 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:44.323397 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:44.323822 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:44.510508 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:44.518802 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:44.519582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3438ea3d-6405-41df-965b-2b8aca1bf70b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.249358 Jul 28 06:29:44.522501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 114/226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:44 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:44.527882 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e55d1e77-3a9b-4753-a67b-daea0f3d949b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.216906 Jul 28 06:29:44.528466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 113/227] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:44 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:45.545207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:45.546772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:45.551659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:45.552275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:45.557522 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:45.558102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:45.558992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:45.559115 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:45.559451 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:45.559718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:45.561890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:45.569690 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:45.822896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:45.830499 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-840fa969-00bf-4565-b6ab-4a217d368d92 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.290645 Jul 28 06:29:45.831937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 115/228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:45 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:45.845458 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:45.853229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7467405b-c488-4bb4-83d0-1cb2a1c02504 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.307178 Jul 28 06:29:45.853841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 114/229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:45 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:46.007046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-2ea97920-d266-429f-bfcf-699d853c84a5 req-a6cd3b16-3158-4fc7-b5c7-28395f2e3419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fda205-aef8-408a-896a-af9e873d080f", "tag": "95ad8b0e-0e88-44ee-9dbe-ee750bb37f37"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:46.024397 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2ea97920-d266-429f-bfcf-699d853c84a5 req-a6cd3b16-3158-4fc7-b5c7-28395f2e3419 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:46.024843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-2ea97920-d266-429f-bfcf-699d853c84a5 req-a6cd3b16-3158-4fc7-b5c7-28395f2e3419 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:46.036452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-2ea97920-d266-429f-bfcf-699d853c84a5 req-a6cd3b16-3158-4fc7-b5c7-28395f2e3419 service nova] Creating event network-changed:95ad8b0e-0e88-44ee-9dbe-ee750bb37f37 for instance 40fda205-aef8-408a-896a-af9e873d080f on hv-cinder-81242 Jul 28 06:29:46.041344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-2ea97920-d266-429f-bfcf-699d853c84a5 req-a6cd3b16-3158-4fc7-b5c7-28395f2e3419 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039813 Jul 28 06:29:46.041942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 116/230] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:46.853651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:46.854370 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:46.861948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:46.862633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:46.863788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:46.864692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:46.880423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:46.882133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:46.888986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:46.889637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:46.890407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:46.890997 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:47.103472 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:47.111671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:47.112381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9ed4238f-62be-40ac-8813-4c51e2582459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.264597 Jul 28 06:29:47.113154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 115/231] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:46 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:47.119392 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5635ba5c-faca-49c4-a75f-a7d2f3d75551 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.246084 Jul 28 06:29:47.120316 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 117/232] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:46 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:48.132570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:48.133179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:48.142057 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:48.143359 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:48.144659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:48.145114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:48.146292 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:48.146495 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:48.150174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:48.150629 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:48.151534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:48.151840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:48.357692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:48.369509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b893c5ac-d237-4876-ab2e-12da6ac778a1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.237315 Jul 28 06:29:48.369509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 116/233] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:48 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:48.399487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:48.408644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7009403e-1c73-43e9-984a-1106a685c427 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.270672 Jul 28 06:29:48.412827 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 118/234] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:48 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:49.394532 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:49.394532 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:49.396530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:49.396530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:49.396738 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:49.397546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:49.431399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:49.431399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:49.439004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:49.439651 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:49.440630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:49.441198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:49.567202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:49.589979 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:49.597614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:49.605480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ea0a8c47-ced0-4f56-84fe-b7798a272d05 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.221043 Jul 28 06:29:49.606049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 117/235] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:49 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:49.619591 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:49.626778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2e8e2406-e772-4389-b2ff-860c0580109b tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.200466 Jul 28 06:29:49.627485 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 119/236] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:49 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:50.627896 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:50.628435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:50.630291 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:50.635119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:50.635569 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:50.636325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:50.636754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:50.648657 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:50.649264 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:50.656719 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:50.657206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:50.658033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:50.658417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:50.842416 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:50.846154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:50.851390 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-63641e56-2a9d-4da0-98bd-36b35784fb83 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.228081 Jul 28 06:29:50.851972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 118/237] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:50 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:50.858679 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9f2375b8-8826-400a-a5e8-3ef6ebe0fad7 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.215032 Jul 28 06:29:50.859302 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 120/238] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:50 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:51.873889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:51.874502 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:51.880066 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:51.880676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:51.889591 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:51.889864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:51.890043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:51.890302 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:51.890813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:51.891054 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:51.891243 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:51.891480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:52.149797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:52.156096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:52.157499 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5d2990bf-76b0-47ff-91bc-a010af1d55d0 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.281511 Jul 28 06:29:52.158177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 121/239] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:51 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:52.176004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f60049dc-5d60-496e-9cdc-cf469a7fc613 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1521 microversion: 2.1 time: 0.305833 Jul 28 06:29:52.190107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 119/240] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:51 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:53.180186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:53.180820 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:53.187352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:53.187810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:53.188573 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:53.189246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:53.198877 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:53.199950 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:53.207390 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:53.207921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:53.208750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:53.209471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:53.621230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:53.626276 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:53.631585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-450a9696-8204-4532-a608-03ee5bdfa26a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.455167 Jul 28 06:29:53.632511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 122/241] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:53 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:53.638467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-efa59c09-d48c-4962-b827-e4590fd5c818 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1501 microversion: 2.1 time: 0.443257 Jul 28 06:29:53.639716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 120/242] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:53 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1501 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:53.662067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:53.663752 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:53.671493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:53.672230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:53.673174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:53.673850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:53.692134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:53.856037 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:53.864366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-179037a5-3e0e-4bc9-be75-0ca383957787 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1515 microversion: 2.1 time: 0.208424 Jul 28 06:29:53.864987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 123/243] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:53 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:54.658915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:54.667357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:54.667357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:54.667357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:54.667357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:54.667934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:54.807423 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:54.815494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-830c13c1-a77f-4ca2-9c6b-d14cefe4b3a6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.161500 Jul 28 06:29:54.816030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 121/244] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:54 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:55.838971 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:55.840073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:55.848303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:55.848840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:55.849715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:55.850226 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:55.984202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:55.992308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d42a0656-04b7-415a-a44f-948cac75ead4 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.157400 Jul 28 06:29:55.994455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 124/245] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:55 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:57.013766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:57.014366 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:57.020635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:57.021069 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:57.021860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:57.022283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:57.152382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:57.160802 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3a1cfbb8-f8d1-462e-9e5b-6f653eb1c28f tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.150751 Jul 28 06:29:57.161426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 122/246] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:57 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:57.746704 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:57.748958 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:57.755539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:57.755988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:57.756810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:57.757236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:57.779996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lazy-loading 'flavor' on Instance uuid 304ff8e1-a50f-4e7e-a0df-39476ea30e25 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:29:58.181123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:58.181824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:58.183820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:29:58.188608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:58.189113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:58.189927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:58.190871 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:58.257959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2528ae18-aa27-4488-be41-54191bdc4864 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/action" status: 200 len: 32 microversion: 2.1 time: 0.509991 Jul 28 06:29:58.259659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 125/247] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:29:57 2022] POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:29:58.289973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:58.289973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:58.291493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:58.292105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:58.293351 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:58.293989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:58.454158 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:58.462322 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f8be63ba-d594-4149-b31c-09b36900257a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.285010 Jul 28 06:29:58.462978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 123/248] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:58 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:58.559106 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:58.566642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d8b607aa-cb2c-4d9f-b284-1c33eaa224ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.294880 Jul 28 06:29:58.567216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 126/249] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:58 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:29:58.970005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-6c3f5669-259a-42b9-9698-2ca2e6a40007 req-0a0d4e89-a9f7-49d7-a175-e20c27c43666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fda205-aef8-408a-896a-af9e873d080f", "name": "network-vif-plugged", "status": "completed", "tag": "95ad8b0e-0e88-44ee-9dbe-ee750bb37f37"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:29:58.980306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-6c3f5669-259a-42b9-9698-2ca2e6a40007 req-0a0d4e89-a9f7-49d7-a175-e20c27c43666 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:58.980750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-6c3f5669-259a-42b9-9698-2ca2e6a40007 req-0a0d4e89-a9f7-49d7-a175-e20c27c43666 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:58.993264 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-6c3f5669-259a-42b9-9698-2ca2e6a40007 req-0a0d4e89-a9f7-49d7-a175-e20c27c43666 service nova] Creating event network-vif-plugged:95ad8b0e-0e88-44ee-9dbe-ee750bb37f37 for instance 40fda205-aef8-408a-896a-af9e873d080f on hv-cinder-81242 Jul 28 06:29:58.998173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-6c3f5669-259a-42b9-9698-2ca2e6a40007 req-0a0d4e89-a9f7-49d7-a175-e20c27c43666 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032003 Jul 28 06:29:58.998796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 124/250] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:29:59.484402 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:59.484833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:59.492117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:59.492566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:59.493364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:59.493856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:59.594449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:29:59.594449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:29:59.600384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:59.601110 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:59.602097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:29:59.602608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:29:59.705867 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:59.722249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-09353fde-c664-4065-8e50-a2ed4717f2fe tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.241760 Jul 28 06:29:59.723126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 127/251] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:59 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:29:59.777348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:29:59.784777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1fdf43d5-5c1a-456d-9c82-09c544e30785 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.201444 Jul 28 06:29:59.785478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 125/252] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:29:59 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:00.743406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:00.743936 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:00.750473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:00.750909 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:00.751661 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:00.752084 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:00.806210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:00.806814 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:00.813134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:00.813599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:00.814361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:00.814790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:00.914842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:00.922417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d4d2eac5-3461-40a0-847a-9df95713cb6a tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.182960 Jul 28 06:30:00.922981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 128/253] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:00 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:00.975372 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:00.982815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-56262935-8bea-4ffd-a6a0-5cd078c1fa34 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.180454 Jul 28 06:30:00.983386 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 126/254] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:00 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:01.943556 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:01.944138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:01.950583 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:01.951030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:01.951790 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:01.952226 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:02.004106 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:02.004707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:02.011026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:02.011531 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:02.012274 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:02.012712 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:02.126987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:02.137744 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9ca7f495-1836-405f-b988-fead8cbb4af3 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.198072 Jul 28 06:30:02.138423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 129/255] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:01 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:02.174597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:02.184116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f2a398ad-7371-47c6-b1e0-e3247ed5cda5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.183886 Jul 28 06:30:02.184697 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 127/256] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:01 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:03.157734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:03.158529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:03.169528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:03.169528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:03.169528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:03.169528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:03.209156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:03.209972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:03.219232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:03.219861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:03.220652 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:03.221118 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:03.366548 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:03.379901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9e3a10be-6ba4-48dc-ac23-0fa48d26cdfd tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.225826 Jul 28 06:30:03.381101 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 130/257] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:03 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:03.402624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:03.410394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4f5e8802-93c0-4fe0-a137-5c03ea13fd5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.205737 Jul 28 06:30:03.411095 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 128/258] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:03 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:04.403530 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:04.404136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:04.411453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:04.412630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:04.413545 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:04.413982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:04.432283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:04.432936 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:04.439023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:04.439470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:04.440234 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:04.440671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:04.620084 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:04.624359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:04.626675 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:04.627675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-45eb870b-5501-4955-b830-67f4d13247f5 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.228458 Jul 28 06:30:04.628255 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 131/259] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:04 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:04.633177 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5386639-f1dd-4b12-80ed-2e6a57a08be5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.205474 Jul 28 06:30:04.633775 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 129/260] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:04 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:05.650167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:05.650771 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:05.657161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:05.657632 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:05.658404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:05.658836 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:05.660353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:05.660972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:05.668060 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:05.668614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:05.669416 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:05.670199 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:05.857758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:05.865062 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:05.865215 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4576ce30-8f48-4815-b0c0-370222a1b163 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1314 microversion: 2.1 time: 0.219496 Jul 28 06:30:05.866630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 132/261] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:05 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:05.873519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3a1a9f65-f7ba-4d55-ab50-547a64b6d0b4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.217490 Jul 28 06:30:05.874083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 130/262] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:05 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:06.887868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:06.889888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:06.895390 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:06.895841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:06.896250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:06.896882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:06.896987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:06.897075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:06.904134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:06.904583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:06.905374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:06.905815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:07.102634 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:07.106902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:07.110693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ba61b651-d036-4c84-8a6a-ce44566e96bb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1498 microversion: 2.1 time: 0.226621 Jul 28 06:30:07.116248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 133/263] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:06 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:07.116369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4e350ddc-f90e-422c-aa64-e998e2b58f93 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.223369 Jul 28 06:30:07.116369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 131/264] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:06 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:08.136083 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:08.136781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:08.143610 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:08.144024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:08.144811 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:08.145533 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:08.254678 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:08.255856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:08.262546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:08.263116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:08.263748 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:08.264220 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:08.294902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:30:08.302722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:08.310898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-086b83ff-98b3-4e29-91a0-8a6cbcad7e2d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.179048 Jul 28 06:30:08.311468 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 134/265] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:08 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:08.603322 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f00eb649-fa3b-4745-adff-7a034264ca3d tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "DELETE /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 204 len: 0 microversion: 2.1 time: 0.352240 Jul 28 06:30:08.604211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 132/266] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:30:08 2022] DELETE /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:30:08.612594 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:08.613204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:08.619449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:08.619810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:08.620581 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:08.621007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:08.756464 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:08.767802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7cf75e71-6223-4853-b3ad-f52ed0fcdc70 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1504 microversion: 2.1 time: 0.158933 Jul 28 06:30:08.768391 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 135/267] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:08 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:09.332763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:09.334049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:09.349992 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:09.350457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:09.351977 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:09.352488 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:09.500398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:09.510320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2d3efe02-c8e4-4692-a358-60a9a56d8fa7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.180552 Jul 28 06:30:09.510320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 133/268] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:09 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:09.791503 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:09.792115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:09.799146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:09.799600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:09.800378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:09.800816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:09.937889 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:09.945977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f454b516-4dc1-43f5-8fa7-164977b7f173 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1504 microversion: 2.1 time: 0.158887 Jul 28 06:30:09.946551 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 136/269] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:09 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:10.530383 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:10.531095 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:10.537185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:10.537676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:10.538431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:10.538922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:10.675614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:10.683598 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9d165006-692b-4d78-a743-a8909dece0a4 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.157152 Jul 28 06:30:10.684169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 134/270] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:10 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:10.968112 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:10.968666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:10.975268 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:10.975747 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:10.977187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:10.977732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:11.108246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:11.115765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-97b4e7e7-4c19-4c05-888b-9739a2001ebb tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1504 microversion: 2.1 time: 0.151550 Jul 28 06:30:11.116338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 137/271] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:10 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:11.705665 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:11.706446 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:11.713083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:11.713833 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:11.714607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:11.715037 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:11.847968 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:11.855777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-92c4d11a-cb1f-4daa-bc2d-7ea7f0bd6653 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.153908 Jul 28 06:30:11.856350 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 135/272] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:11 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:12.138015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:12.138626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:12.145145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:12.145630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:12.146404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:12.146844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:12.151929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:12.296408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:12.304950 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ca31c08d-ca6b-4f16-bade-e8ac8cc9c301 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1504 microversion: 2.1 time: 0.170713 Jul 28 06:30:12.305554 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 138/273] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:12 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:12.878611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:12.879659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:12.889691 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:12.890114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:12.890897 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:12.891947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:13.118524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:13.130151 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3356b3c2-e198-4832-b80b-41a12b5c2063 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.256477 Jul 28 06:30:13.130936 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 136/274] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:12 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:13.329592 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-592453a3-3255-496c-80fd-cabe966550d9 req-3e8587c7-5153-48de-9c8d-284dfdd979fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fda205-aef8-408a-896a-af9e873d080f", "name": "network-vif-deleted", "tag": "95ad8b0e-0e88-44ee-9dbe-ee750bb37f37"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:13.331519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:13.332249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:13.342861 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-592453a3-3255-496c-80fd-cabe966550d9 req-3e8587c7-5153-48de-9c8d-284dfdd979fb service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:13.343617 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-592453a3-3255-496c-80fd-cabe966550d9 req-3e8587c7-5153-48de-9c8d-284dfdd979fb service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:13.345035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:13.345533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:13.348732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:13.348732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:13.360056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-592453a3-3255-496c-80fd-cabe966550d9 req-3e8587c7-5153-48de-9c8d-284dfdd979fb service nova] Creating event network-vif-deleted:95ad8b0e-0e88-44ee-9dbe-ee750bb37f37 for instance 40fda205-aef8-408a-896a-af9e873d080f on hv-cinder-81242 Jul 28 06:30:13.370577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-592453a3-3255-496c-80fd-cabe966550d9 req-3e8587c7-5153-48de-9c8d-284dfdd979fb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051792 Jul 28 06:30:13.370966 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 139/275] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:13.459411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:13.467920 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-169fea73-97f3-409f-a8bb-dc6dfa296ff6 tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1462 microversion: 2.1 time: 0.144871 Jul 28 06:30:13.468512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 137/276] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:13 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1462 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:14.154045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:14.154973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:14.161700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:14.162404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:14.163907 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:14.164592 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:14.381548 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:14.391662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ab48826d-6611-4e9c-94e1-0a921234b871 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.242172 Jul 28 06:30:14.417254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 140/277] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:14 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:14.490416 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:14.492725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:14.500624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:14.506197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:14.506197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:14.506197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:14.543960 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:14.544622 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:14.545075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lazy-loading 'fault' on Instance uuid 40fda205-aef8-408a-896a-af9e873d080f {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:30:14.591939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2a7c1097e0421492e8460e9b64a27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a64b6b084848ec89599880170c719e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:14.599133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3bb0ab3b-401e-4938-8ba8-9f3d42492d4e tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 200 len: 1304 microversion: 2.1 time: 0.112668 Jul 28 06:30:14.599769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 138/278] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:14 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:15.416329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:15.416946 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:15.420673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=54 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:15.424203 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:15.425408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:15.425408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:15.425868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:15.594698 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:15.603011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e4c080a8-2afc-4163-965b-70a14c99f095 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.191408 Jul 28 06:30:15.603593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 141/279] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:15 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:15.626324 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:15.626947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] [instance: 40fda205-aef8-408a-896a-af9e873d080f] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:15.643053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:15.643602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:15.644447 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:15.644948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:15.667077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] HTTP exception thrown: Instance 40fda205-aef8-408a-896a-af9e873d080f could not be found. Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Request method failure captured: Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f HTTP/1.1 Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyuYpJys2L5eVSRLBKRaa5Poz8S797zX_YyobS1TicnCS7NgN0UEPXeW-QjDuV6gBXXLBZoswDlHqUIgryly_byRHJdkcuPuQElS1qRUpsAJytWIm0n0q_BmycHa_yo6LgG0uyFYkN7e6HraDcPB26eaOJwJUwUmjYrxKngmjGLL0w Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 22a64b6b084848ec89599880170c719e Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesActionsTest-1879553753 Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:30:15.668895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/22a64b6b084848ec89599880170c719e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_22a64b6b084848ec89599880170c719e", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22a64b6b084848ec89599880170c719e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/22a64b6b084848ec89599880170c719e"}]}] Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesActionsTest-1879553753 Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 22a64b6b084848ec89599880170c719e Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesActionsTest-1879553753 Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesActionsTest-1879553753-project Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: eb2a7c1097e0421492e8460e9b64a27b Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesActionsTest-1879553753-project Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance 40fda205-aef8-408a-896a-af9e873d080f could not be found. Jul 28 06:30:15.670319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': '40fda205-aef8-408a-896a-af9e873d080f'} Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fda205-aef8-408a-896a-af9e873d080f could not be found. Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:15.671058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fda205-aef8-408a-896a-af9e873d080f could not be found. Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fda205-aef8-408a-896a-af9e873d080f could not be found. Jul 28 06:30:15.672203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:30:15.673212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] Returning 404 to user: Instance 40fda205-aef8-408a-896a-af9e873d080f could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:15.673212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-63279769-53f5-4a65-abbd-c9c6f8bbb2ed tempest-VolumesActionsTest-1879553753 tempest-VolumesActionsTest-1879553753-project] 10.222.0.69 "GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f" status: 404 len: 111 microversion: 2.1 time: 0.048627 Jul 28 06:30:15.673212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 139/280] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:15 2022] GET /compute/v2.1/servers/40fda205-aef8-408a-896a-af9e873d080f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:30:16.625134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:16.625773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:16.633512 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:16.639282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:16.639282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:16.639282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:16.785607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:16.793707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7c152fc3-8054-43d2-b495-b53498ad2142 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.172888 Jul 28 06:30:16.794297 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 142/281] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:16 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:17.815587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:17.816187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:17.823396 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:17.823834 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:17.824592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:17.825016 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:17.961471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:17.969439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d09eba0a-a4f4-42ae-89d0-ce0c408057fa tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.157564 Jul 28 06:30:17.970010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 140/282] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:17 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:18.991767 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:18.992442 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:18.999258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:18.999698 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:19.000459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:19.000887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:19.151176 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:19.159417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bb8e4d5a-0ec6-47b0-ad79-4e60392e7c89 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.171839 Jul 28 06:30:19.161809 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 143/283] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:18 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:20.187289 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:20.188511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:20.195554 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:20.196035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:20.196818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:20.197254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:20.341585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:20.361322 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cb5da736-697e-43ea-b1fe-2c1502ccbaa3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.168348 Jul 28 06:30:20.367988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 141/284] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:20 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:21.386980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:21.388242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:21.405924 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:21.406373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:21.407152 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:21.407594 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:21.425908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-859367549", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:21.480702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] validate_networks() for None {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:30:21.709169 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:21.720006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-551cecb4-ba20-4af5-884d-d2b3f44561a5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.337140 Jul 28 06:30:21.727703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 144/285] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:21 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:21.850231 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:30:21.850888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:30:21.851381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:30:21.851795 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:30:21.852206 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:30:21.863485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:21.864103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:21.865007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:21.865385 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:21.892702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Getting quotas for project 08e27723b1224589a896eab04740dffc. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:30:21.899022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Getting quotas for user 85d2763ce8a64f128f28ae36a50a8890 and project 08e27723b1224589a896eab04740dffc. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:30:21.931104 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:30:21.933924 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:30:22.095041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3972d070-7e1c-4ff5-8a8f-1aebbb65a977 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673716 Jul 28 06:30:22.096500 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 142/286] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:30:22.109931 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-61d14570-1fad-444d-951e-bfdfa8d3974d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:22.110814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-61d14570-1fad-444d-951e-bfdfa8d3974d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:22.308537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-61d14570-1fad-444d-951e-bfdfa8d3974d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:22.319795 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-61d14570-1fad-444d-951e-bfdfa8d3974d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1214 microversion: 2.1 time: 0.213313 Jul 28 06:30:22.320868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 145/287] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:22 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:22.744078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:22.744679 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:22.750999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:22.751453 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:22.752221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:22.752658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:22.943762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:22.951610 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e836cabd-91d1-4af8-ba0e-9daefcd45f09 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.212796 Jul 28 06:30:22.952183 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 143/288] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:22 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:23.361000 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.362011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:23.374957 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:23.375708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:23.385685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:23.385685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:23.455098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:23.463758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ed567bc4-2c1d-4a02-a9db-181b5b35d2b5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1218 microversion: 2.1 time: 0.115465 Jul 28 06:30:23.464946 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 146/289] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:23.978032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:23.979029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:23.986703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:23.987576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:23.988525 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:23.990288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:24.218899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:24.243275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fcdf8764-771c-41ba-9409-848e4847b5b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.267430 Jul 28 06:30:24.262424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 144/290] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:23 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:24.504152 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:24.505768 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:24.514914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:24.516572 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:24.517642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:24.518729 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:24.598485 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:24.609773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e49b2edc-4935-48f6-9169-e2433f692287 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1210 microversion: 2.1 time: 0.109601 Jul 28 06:30:24.610722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 147/291] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:24 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:25.270538 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.272655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.280938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.281648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.282687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.283196 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.395015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.395908 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.406880 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.408072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.410549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.411123 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.465619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6b43720b-619f-4b1e-83b7-d365f57e6f59 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/ips" status: 200 len: 146 microversion: 2.1 time: 0.076910 Jul 28 06:30:25.466225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 148/292] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/ips => generated 146 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:25.557604 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:25.560695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:25.571617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8a507b40-f885-4017-b5ae-317819cdf46f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1501 microversion: 2.1 time: 0.305437 Jul 28 06:30:25.572810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 145/293] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1501 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:25.601154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98340640-78ff-40fd-9194-3e6abf4193f0"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:25.604554 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.623189 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.623953 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.625102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.626090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.633826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.634867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.642757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.643454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.644463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.648709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.693955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] HTTP exception thrown: Cannot 'attach_volume' instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 while it is in vm_state rescued Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Request method failure captured: Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/os-volume_attachments HTTP/1.1 Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 74 Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyFZqivNqvdDUS-uLdFM5ziieab-PJrUIzmvCD-ZoZIRHY0SfXjhsvjF9tt_kdGSoem1WjbHFQ-9pMnCRFcH4pkOEMkMxgTJx-G-k-98K_Q3r2U03P_NI14JJAwV3mV-llB9l6nzFnP4Lt_fWfVVhcQZj7mS2MzIq-U6MwSpJLQW6I Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:30:25.697050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cd88554db98441c99e0b09b446c24b47", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}] Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 86a5553819d949ffbc64b7a388942baf Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {"volumeAttachment": {"volumeId": "98340640-78ff-40fd-9194-3e6abf4193f0"}} Jul 28 06:30:25.698417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Cannot 'attach_volume' instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 while it is in vm_state rescued Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'server_id': '304ff8e1-a50f-4e7e-a0df-39476ea30e25', 'body': {'volumeAttachment': {'volumeId': '98340640-78ff-40fd-9194-3e6abf4193f0'}}} Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:25.699158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 while it is in vm_state rescued Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:25.700304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 while it is in vm_state rescued Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Returning 409 to user: Cannot 'attach_volume' instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 while it is in vm_state rescued {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b9928e6b-8b98-4e10-965c-9f1acafa8aba tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.107969 Jul 28 06:30:25.710104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 149/294] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:30:25 2022] POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/os-volume_attachments => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 06:30:25.718821 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:25.719784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.729808 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.730588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.731639 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.732279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:25.782896 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:25.794137 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f58050b7-9a59-44da-b6b1-72e2d07c83c0 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1284 microversion: 2.1 time: 0.166087 Jul 28 06:30:25.794962 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 146/295] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:25.958977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-30ed6639-7b00-49ea-a796-798f36b52a60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/action" status: 202 len: 0 microversion: 2.1 time: 0.246741 Jul 28 06:30:25.961329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 150/296] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:30:25 2022] POST /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:30:25.974577 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.977727 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.995005 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:25.995624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:25.996803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:25.998708 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:26.000428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:26.001431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:26.012185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:26.014344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:26.014459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:26.015642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:26.045449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7099250d-395e-4487-aba4-ed05348f79b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/ips" status: 200 len: 152 microversion: 2.20 time: 0.055782 Jul 28 06:30:26.046184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 151/297] 10.222.0.69 () {60 vars in 1289 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:30:26.446462 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:26.460018 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-678a217f-8a51-4014-84fe-7902b8cd66b8 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1509 microversion: 2.1 time: 0.492171 Jul 28 06:30:26.461008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 147/298] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:25 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:26.824843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:26.826336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:26.842635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:26.844246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:26.844766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:26.847090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:27.027586 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:27.041673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-40525499-95d5-41c8-95f1-3ac145308dc1 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1272 microversion: 2.1 time: 0.221451 Jul 28 06:30:27.042773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 152/299] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:26 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:27.486162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:27.486779 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:27.503873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:27.507470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:27.507470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:27.507470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:27.871582 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:27.887399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fdd870fa-0417-49df-abd3-b4689258b52f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1509 microversion: 2.1 time: 0.403560 Jul 28 06:30:27.889259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 148/300] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:27 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:28.089923 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:28.091999 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:28.107580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:28.108444 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:28.109971 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:28.110593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:28.428794 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:28.443083 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ff734d3b-0ead-4156-b2d4-e2f2c9dd65a5 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.369707 Jul 28 06:30:28.457061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 153/301] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:28 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:28.918769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:28.919438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:28.921466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:28.928239 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:28.928714 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:28.932315 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:28.943919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.307498 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-7e47e916-b387-4fe2-8914-d99cc811527f req-b1f29db8-8b78-4e8a-a4c1-d4f88e8fb584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722dc269-7492-4026-9b2e-c8d4a75a940a", "tag": "267fca0b-608d-4e11-b057-e23a1994bbd9"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:29.309895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:29.321407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-666b8987-c4b5-431a-a4e1-7435b25044a0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1509 microversion: 2.1 time: 0.411214 Jul 28 06:30:29.322375 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 149/302] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:28 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1509 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:29.338922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-7e47e916-b387-4fe2-8914-d99cc811527f req-b1f29db8-8b78-4e8a-a4c1-d4f88e8fb584 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.339396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-7e47e916-b387-4fe2-8914-d99cc811527f req-b1f29db8-8b78-4e8a-a4c1-d4f88e8fb584 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.365163 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-7e47e916-b387-4fe2-8914-d99cc811527f req-b1f29db8-8b78-4e8a-a4c1-d4f88e8fb584 service nova] Creating event network-changed:267fca0b-608d-4e11-b057-e23a1994bbd9 for instance 722dc269-7492-4026-9b2e-c8d4a75a940a on hv-cinder-81242 Jul 28 06:30:29.376763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-7e47e916-b387-4fe2-8914-d99cc811527f req-b1f29db8-8b78-4e8a-a4c1-d4f88e8fb584 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073176 Jul 28 06:30:29.379811 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 154/303] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:30:29.464902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:29.465555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:29.480451 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.484317 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.484317 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.484317 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.514674 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:29.517952 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:29.535125 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.535649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.536449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.536884 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.590398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lazy-loading 'flavor' on Instance uuid dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:30:29.718590 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:29.730461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5fe4c8eb-9e1a-4a12-a2aa-0c2cf0d0a366 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.270149 Jul 28 06:30:29.732702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 150/304] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:29 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:29.779138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:29.932154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:29.933278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:29.951068 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.951792 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.952772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:29.953421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:29.988421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c1483c69-bab5-448c-97b3-e6c3c46d701c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/ips" status: 200 len: 151 microversion: 2.1 time: 0.060210 Jul 28 06:30:29.990774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 151/305] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:30:29 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:30.359272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:30.359936 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:30.382230 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:30.383097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:30.384355 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:30.385153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:30.746984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:30.779812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-81d9b617-7520-47c5-b3c9-6067b23980e3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1515 microversion: 2.1 time: 0.423685 Jul 28 06:30:30.782996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 152/306] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:30 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:30.796116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:30.807970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:30.829398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:30.829398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:30.829398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:30.829398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:31.187803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:31.209982 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-35ee15be-cecf-4629-bb0d-4029c7bc8f51 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.411360 Jul 28 06:30:31.209982 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 153/307] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:30 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:31.486810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6914d5b1-47c6-4c61-b862-5aba252019b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/action" status: 202 len: 0 microversion: 2.20 time: 1.976280 Jul 28 06:30:31.487479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 155/308] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Jul 28 06:30:29 2022] POST /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/action => generated 0 bytes in 1978 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:30:31.495772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:31.499394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:31.505685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:31.506686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:31.507457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:31.507891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:31.668398 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:31.686418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:31.688233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:31.695955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2198105f-8b1c-4f97-9fe4-8825cd03eb5a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.203429 Jul 28 06:30:31.698409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 154/309] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:31 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:32.007227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a71c0625-896f-4a13-8732-a9aa49946052"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:32.012967 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:32.041760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:32.042220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:32.044192 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:32.044630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:32.226354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:32.228046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:32.230029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:32.230873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:32.237409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:32.237857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:32.238845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:32.239277 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:32.314353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:32.393623 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:32.401552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b33ca690-54d4-4e90-98bc-ed7aee9b0dcd tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.181845 Jul 28 06:30:32.402120 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 155/310] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:32 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:32.726343 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:32.727796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:32.746628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:32.746628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:32.746628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:32.746628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:33.022758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:33.031089 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:33.032857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:33.034367 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4e6c1a27-4da4-4a79-9518-59e5ce494aa6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.315057 Jul 28 06:30:33.034784 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 156/311] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:32 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:33.040632 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39496db6-a25f-4aa9-8389-4fccce4c981d"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:33.043391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:33.049902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:33.050516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:33.051485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:33.051942 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:33.459566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-095800e8-0c53-47d7-aad2-b38f25e83784 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.459223 Jul 28 06:30:33.470619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 156/312] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:30:31 2022] POST /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 194 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:33.484270 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f852558f-9e4f-403f-a523-bc32120bfcbd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'create', calling method: .version_select at 0x7fbe627988b0>, body: {"keypair": {"name": "tempest-keypair-332791501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe9GiQG+7t6LQM7ntli9+5ddwktp+Y8Cl8PByqHWzDrP8DLqhw8XbCNcK+2y1j8yYiXkY7FQvlkU/nJNtdT600idd4+zc5VeGS/EwNlNzJWK03exBem+MN809xNiZ2Xsg=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:33.529222 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f852558f-9e4f-403f-a523-bc32120bfcbd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for project cd88554db98441c99e0b09b446c24b47. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:30:33.535136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f852558f-9e4f-403f-a523-bc32120bfcbd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for user 86a5553819d949ffbc64b7a388942baf and project cd88554db98441c99e0b09b446c24b47. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:30:33.665932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f852558f-9e4f-403f-a523-bc32120bfcbd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.192711 Jul 28 06:30:33.667430 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 157/313] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:30:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:33.673072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:33.674194 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:33.692976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:33.697693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:33.698749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:33.699337 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:33.966899 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:33.976980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d411b87d-f677-485d-b27d-9d0dd4976dfc tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.308160 Jul 28 06:30:33.978233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 158/314] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:33 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:34.059999 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:34.060621 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:34.067151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:34.068844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:34.068844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:34.068844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:34.264269 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:34.273153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:34.275119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:34.276344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a5750012-cdf4-4fcc-90ba-cc75d538274f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.221418 Jul 28 06:30:34.276914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 159/315] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:34 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:35.006275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:35.007980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:35.021780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:35.026235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:35.028991 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:35.033951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:35.186742 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-99dc07d5-9a22-4c97-903a-2da2aa013d2b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.150121 Jul 28 06:30:35.187294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 157/316] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:30:33 2022] POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-volume_attachments => generated 194 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:35.286739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:35.294714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-22c07dd4-c8e3-43d5-961f-69e59491537d tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.298883 Jul 28 06:30:35.302031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:35.302935 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:35.307258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 160/317] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:34 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:35.313027 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:35.313755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:35.315005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:35.315602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:35.498857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:35.512808 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:35.514836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:35.517202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f536258e-5968-440b-ae70-d83a2aca8a45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.220734 Jul 28 06:30:35.517954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 158/318] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:35 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:36.329053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:36.329705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:36.339588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:36.339959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:36.340736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:36.341184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:36.540078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:36.541907 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:36.559810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:36.560541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:36.561535 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:36.561970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:36.583842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:36.599717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ed9c6605-4c5c-4432-b288-bd59afbc27b4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.274643 Jul 28 06:30:36.601870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 161/319] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:36 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:36.799017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:36.813855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:36.817928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:36.820216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7be638e0-c955-4906-8bba-87f00c893f91 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.283632 Jul 28 06:30:36.822030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 159/320] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:36 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:36.924095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1190432190", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6978cd1-c187-431b-a4d2-24672b7a1261"}], "security_groups": [{"name": "tempest-securitygroup--940504564"}], "key_name": "tempest-keypair-332791501", "user_data": "}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:37.079572 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] validate_networks() for [('c6978cd1-c187-431b-a4d2-24672b7a1261', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:30:37.276763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-8b8d6502-0069-469d-bdc4-992835d72c54 req-2684fb45-fdd6-4175-8dbc-054d815681c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722dc269-7492-4026-9b2e-c8d4a75a940a", "name": "network-vif-plugged", "status": "completed", "tag": "267fca0b-608d-4e11-b057-e23a1994bbd9"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:37.302922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-8b8d6502-0069-469d-bdc4-992835d72c54 req-2684fb45-fdd6-4175-8dbc-054d815681c5 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:37.303473 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-8b8d6502-0069-469d-bdc4-992835d72c54 req-2684fb45-fdd6-4175-8dbc-054d815681c5 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:37.318219 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-8b8d6502-0069-469d-bdc4-992835d72c54 req-2684fb45-fdd6-4175-8dbc-054d815681c5 service nova] Creating event network-vif-plugged:267fca0b-608d-4e11-b057-e23a1994bbd9 for instance 722dc269-7492-4026-9b2e-c8d4a75a940a on hv-cinder-81242 Jul 28 06:30:37.326081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-8b8d6502-0069-469d-bdc4-992835d72c54 req-2684fb45-fdd6-4175-8dbc-054d815681c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056031 Jul 28 06:30:37.327353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 160/321] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:37.627875 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:37.629457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:37.639216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:37.639811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:37.647560 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:37.647560 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:38.013506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:30:38.014090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:30:38.025449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:30:38.025449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:30:38.025449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:30:38.028986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:38.053425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:38.053425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:38.053425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:38.053425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:38.053769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f51cedcd-c249-45f8-bae0-706d2363859c tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.425536 Jul 28 06:30:38.053769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 161/322] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:37 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:38.061586 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:38.062268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:38.073953 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:38.074416 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:38.075771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:38.076221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:38.079479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:38.117149 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for project cd88554db98441c99e0b09b446c24b47. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:30:38.139086 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Getting quotas for user 86a5553819d949ffbc64b7a388942baf and project cd88554db98441c99e0b09b446c24b47. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:30:38.182198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:30:38.182198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:30:38.284986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:38.293923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:38.295422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:38.296641 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3f61d8f8-7c0e-46e3-8f3e-6096e07e7b4c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.243268 Jul 28 06:30:38.301653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 162/323] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:38 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:38.498802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0c7fbc6e-f921-473d-8934-fe1e5ba9388a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.578824 Jul 28 06:30:38.499989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 162/324] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:30:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:30:38.517957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5a4e30fd-ea78-429a-a119-5437a22544e2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:38.519019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5a4e30fd-ea78-429a-a119-5437a22544e2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:38.610605 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a4e30fd-ea78-429a-a119-5437a22544e2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:38.617562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5a4e30fd-ea78-429a-a119-5437a22544e2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1245 microversion: 2.1 time: 0.110630 Jul 28 06:30:38.638357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 163/325] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:38 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:39.082394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:39.083843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:39.092605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:39.093059 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:39.094208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:39.094812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:39.322823 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:39.324803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:39.335209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:39.341150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-42803335-e279-485e-8e0b-bff412391821 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1314 microversion: 2.1 time: 0.264554 Jul 28 06:30:39.343896 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:39.344598 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:39.356808 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:39.356808 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:39.357407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 163/326] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:39 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:39.495656 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:39.504348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:39.505889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:39.507115 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e3b13383-3c5b-449c-93a4-18bc41ab74e2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.187384 Jul 28 06:30:39.512032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 164/327] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:39 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:39.643992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:39.644639 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:39.661935 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:39.663368 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:39.669260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:39.669753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:39.772357 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:39.795019 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-70282011-0eda-4320-87dd-08ccaa6e8ba6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1249 microversion: 2.1 time: 0.154645 Jul 28 06:30:39.796709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 164/328] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:39 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1249 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:40.379078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:40.379860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:40.398594 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.400445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.402078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.407937 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.538623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:40.539245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:40.550778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.551605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.552576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.553166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.662463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:40.670760 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-abf37e96-67ad-4cbb-91ed-ea01d666bdc4 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1463 microversion: 2.1 time: 0.296248 Jul 28 06:30:40.685955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 165/329] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:40 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:40.727048 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:40.727757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:40.735082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.735786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.736758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.737247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.755358 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:40.767774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:40.769491 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:40.771120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0d5af330-bd56-4161-a149-11a9d549f047 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.236299 Jul 28 06:30:40.772258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 165/330] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:40 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:40.774759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:30:40.819777 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:40.820284 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:40.836974 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.837927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.841995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:40.841995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:40.937509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:40.948894 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-15d6c597-d958-46b4-ab31-b5e676b42884 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1249 microversion: 2.1 time: 0.132730 Jul 28 06:30:40.950135 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 166/331] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:40 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1249 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:41.080030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4a78c78f-5495-4a91-9cca-b4e3a11b61f3 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "DELETE /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 204 len: 0 microversion: 2.1 time: 0.358364 Jul 28 06:30:41.080908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 166/332] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:30:40 2022] DELETE /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:30:41.089418 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:41.090565 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:41.111200 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:41.113673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:41.115667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:41.116717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:41.318965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:41.330501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-91763898-b47d-4aa6-9f37-7c54e9af7bfa tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1469 microversion: 2.1 time: 0.242385 Jul 28 06:30:41.330501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 167/333] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:41 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:41.799086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:41.799788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:41.807129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:41.808509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:41.808772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:41.809275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:41.970652 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:41.971253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:41.978162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:41.979175 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:41.980051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:41.980605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:41.986339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:41.992935 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:41.995596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:41.997695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c97a0566-1faf-44ce-b656-1c267ca5fef3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.203241 Jul 28 06:30:41.999424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 167/334] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:41 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:42.092850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:42.107072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d3eb75b2-cda2-4650-9048-19ce6c2bcf43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1249 microversion: 2.1 time: 0.140383 Jul 28 06:30:42.107965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 168/335] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:41 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:42.350699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:42.351550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:42.359973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:42.360393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:42.361229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:42.361684 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:42.632298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:42.655220 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2798c30d-dea9-4254-a244-5cba6eb48f0e tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1469 microversion: 2.1 time: 0.308037 Jul 28 06:30:42.656471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 168/336] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:42 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:43.024206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:43.027997 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:43.039476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:43.040089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:43.043576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:43.044870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:43.132224 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:43.133768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:43.147765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:43.152711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:43.158146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:43.161203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:43.370471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:43.376824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:43.383145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:43.387534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a7390202-6f3f-466d-8ba8-b4ed57e578cc tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1249 microversion: 2.1 time: 0.259341 Jul 28 06:30:43.389498 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:43.390237 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 169/337] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:43 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1249 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:43.390760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-08bc40b4-8ff1-4369-8571-0cc1060fc68f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.372337 Jul 28 06:30:43.401778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 169/338] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:43 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:43.678680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:43.680546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:43.692007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:43.693027 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:43.694783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:43.695228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:43.936805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:43.956494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6031713d-b050-45b9-9566-708e79ec6ee9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1469 microversion: 2.1 time: 0.278704 Jul 28 06:30:43.957109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 170/339] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:43 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:44.417980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:44.420198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:44.430285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:44.434408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:44.435860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:44.436422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:44.437261 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:44.437915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:44.447913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:44.448687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:44.450380 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:44.455933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:44.630480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:44.642090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-698c9ce1-3d34-4d42-adad-980eb2e703ad tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1241 microversion: 2.1 time: 0.231421 Jul 28 06:30:44.659589 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 170/340] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:44 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1241 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:44.825020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:44.839812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:44.842138 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:44.843804 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9bffebd6-159c-4408-bc54-cc53a06e67fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.419558 Jul 28 06:30:44.845147 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 171/341] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:44 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:44.986821 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:44.988560 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:45.006690 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:45.014059 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:45.019817 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:45.020569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:45.476920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:45.497457 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2904b01a-a77c-42bd-95b1-7b29adcbd2d9 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1469 microversion: 2.1 time: 0.517313 Jul 28 06:30:45.498632 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 171/342] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:44 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1469 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:45.760572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:45.764104 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:45.834192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:45.836573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:45.841351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:45.841918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:45.876510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:45.877626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:45.880765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:45.888191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:45.888841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:45.889803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:45.890389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:45.895260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:46.071249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:46.097091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c1b1b375-84f4-455c-8560-3004004a62bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1297 microversion: 2.1 time: 0.382434 Jul 28 06:30:46.097780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 172/343] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:45 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1297 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:46.113553 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3de24d44-3427-40a4-8492-b72cc6f8e8b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: .version_select at 0x7fbe61dd9c10>, body: {"keypair": {"name": "tempest-keypair-1327455864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdGi7csOTm5K5gTlVkFv8zKoa1t/nLx1BWe963NFqey2R3d3KG04/x3oZG6Z1Y37v94lWR7wN4EJli4KXO48aW58upjzA4Ud9fkvUtxj4Fpd3PspVD/LXOXib2WxQTP1w=="}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:46.162571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-3de24d44-3427-40a4-8492-b72cc6f8e8b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:30:46.173283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-3de24d44-3427-40a4-8492-b72cc6f8e8b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:30:46.266609 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3de24d44-3427-40a4-8492-b72cc6f8e8b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167709 Jul 28 06:30:46.267592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 173/344] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:30:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:46.444624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:46.491256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:46.496511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:46.512188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2cc773e-e2d5-4b12-a39f-909c1b1fe142 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.627759 Jul 28 06:30:46.527372 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 172/345] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:45 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:46.542620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:46.545020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:46.556213 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:46.556945 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:46.558174 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:46.559695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:46.830430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:46.853464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-69120d7a-0539-409b-b1bc-e491c7a23bab tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1427 microversion: 2.1 time: 0.329654 Jul 28 06:30:46.877926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 174/346] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:46 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1427 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:47.071583 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-ddddaeba-0a01-438a-90dd-a3f2132b3071 req-4d2c3a53-7539-440b-a567-25750c0da925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722dc269-7492-4026-9b2e-c8d4a75a940a", "name": "network-vif-deleted", "tag": "267fca0b-608d-4e11-b057-e23a1994bbd9"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:47.101578 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ddddaeba-0a01-438a-90dd-a3f2132b3071 req-4d2c3a53-7539-440b-a567-25750c0da925 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.106260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ddddaeba-0a01-438a-90dd-a3f2132b3071 req-4d2c3a53-7539-440b-a567-25750c0da925 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.126663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:47.129951 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:47.143938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.147837 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.151135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.160785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-ddddaeba-0a01-438a-90dd-a3f2132b3071 req-4d2c3a53-7539-440b-a567-25750c0da925 service nova] Creating event network-vif-deleted:267fca0b-608d-4e11-b057-e23a1994bbd9 for instance 722dc269-7492-4026-9b2e-c8d4a75a940a on hv-cinder-81242 Jul 28 06:30:47.164649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.175164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-ddddaeba-0a01-438a-90dd-a3f2132b3071 req-4d2c3a53-7539-440b-a567-25750c0da925 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108851 Jul 28 06:30:47.178295 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 173/347] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:47.404347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:47.413288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-51768da4-62c8-416e-9dba-5ba287b26df0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1303 microversion: 2.1 time: 0.297588 Jul 28 06:30:47.413901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 175/348] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:47 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1303 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:47.553172 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:47.558399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:47.569466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.570668 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.572557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.573167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.866244 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:47.887512 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:47.889155 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:47.890947 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-80dc224a-e923-4091-8cdc-c0373803b6ee tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.342682 Jul 28 06:30:47.892004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 174/349] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:47 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:47.892327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:47.893085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:47.901056 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.901657 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.902506 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.903032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.943799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:47.943799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:47.943799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lazy-loading 'fault' on Instance uuid 722dc269-7492-4026-9b2e-c8d4a75a940a {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:30:48.051457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d2763ce8a64f128f28ae36a50a8890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e27723b1224589a896eab04740dffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:48.064090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-51f5bf6b-48e6-4653-bec9-7b28c5301aef tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 200 len: 1304 microversion: 2.1 time: 0.184152 Jul 28 06:30:48.064874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 176/350] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:47 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:48.435926 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:48.436664 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:48.445044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:48.448154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=10 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:48.452205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:48.452773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:48.455520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:48.455520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:48.920469 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:48.924300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:48.926667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:48.948530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:48.950138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3b8513d4-fcd8-4ce9-b6b8-cf9e47e22b5f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.517160 Jul 28 06:30:48.957450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 175/351] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:48 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:48.960288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:48.965736 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:48.972550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:49.100210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:49.101147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] [instance: 722dc269-7492-4026-9b2e-c8d4a75a940a] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:49.108881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:49.110979 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:49.112609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:49.129853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:49.169279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] HTTP exception thrown: Instance 722dc269-7492-4026-9b2e-c8d4a75a940a could not be found. Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Request method failure captured: Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a HTTP/1.1 Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iz4wcj4QjXct3i3zL3nIek4DIYhd5SosQbuDeIIrvrcLnABVTU8qDINi5ZXN5fapnnm_w4155v0-tYjJfJa0-OrRWYp4yV3CPrKQ8OOxw23PQXg_KVX9UV_Hpa4fVoeIma4VQDHdfTnzvcguDunfBmLVLIJ5AzVnnYAbXiewPboe0s Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 08e27723b1224589a896eab04740dffc Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesNegativeTest-452353750 Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:30:49.174319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/08e27723b1224589a896eab04740dffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_08e27723b1224589a896eab04740dffc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/08e27723b1224589a896eab04740dffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/08e27723b1224589a896eab04740dffc"}]}] Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesNegativeTest-452353750 Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 08e27723b1224589a896eab04740dffc Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesNegativeTest-452353750 Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesNegativeTest-452353750-project Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 85d2763ce8a64f128f28ae36a50a8890 Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesNegativeTest-452353750-project Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 722dc269-7492-4026-9b2e-c8d4a75a940a could not be found. Jul 28 06:30:49.177130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '722dc269-7492-4026-9b2e-c8d4a75a940a'} Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722dc269-7492-4026-9b2e-c8d4a75a940a could not be found. Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:30:49.178263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722dc269-7492-4026-9b2e-c8d4a75a940a could not be found. Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722dc269-7492-4026-9b2e-c8d4a75a940a could not be found. Jul 28 06:30:49.179762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:30:49.182492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] Returning 404 to user: Instance 722dc269-7492-4026-9b2e-c8d4a75a940a could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:30:49.183954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-48055abc-8eee-4c43-9595-62995c34e897 tempest-VolumesNegativeTest-452353750 tempest-VolumesNegativeTest-452353750-project] 10.222.0.69 "GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a" status: 404 len: 111 microversion: 2.1 time: 0.099368 Jul 28 06:30:49.192124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 176/352] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:49 2022] GET /compute/v2.1/servers/722dc269-7492-4026-9b2e-c8d4a75a940a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:30:49.429379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:49.445719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:49.451791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:49.455518 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a2fc35a4-ba0e-44ea-8843-5b1c4c0f7051 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.536838 Jul 28 06:30:49.465790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 177/353] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:48 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:49.972733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:49.975352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:49.986714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:49.987526 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:49.988988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:49.989932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:50.186604 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1564706835", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbc8d74-4a13-4069-9d84-f85f9df7bdf6"}], "security_groups": [{"name": "tempest-securitygroup--1174524548"}], "key_name": "tempest-keypair-1327455864", "user_data": "}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:50.263708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:50.276134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-942a1f6d-4498-44aa-a8a9-f4e6651c39cb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.307658 Jul 28 06:30:50.277997 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 177/354] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:49 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:50.295944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-47c5e66e-a98f-4069-b5e1-36037b97c49c req-264e70ba-e59c-42a4-8565-48eeffdcaed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:50.307153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-47c5e66e-a98f-4069-b5e1-36037b97c49c req-264e70ba-e59c-42a4-8565-48eeffdcaed1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:50.307600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-47c5e66e-a98f-4069-b5e1-36037b97c49c req-264e70ba-e59c-42a4-8565-48eeffdcaed1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:50.337862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-47c5e66e-a98f-4069-b5e1-36037b97c49c req-264e70ba-e59c-42a4-8565-48eeffdcaed1 service nova] Creating event network-changed:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:30:50.344329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-47c5e66e-a98f-4069-b5e1-36037b97c49c req-264e70ba-e59c-42a4-8565-48eeffdcaed1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054163 Jul 28 06:30:50.344949 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 178/355] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:30:50.485893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:50.486986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:50.497174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:50.497984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:50.499336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:50.500092 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:50.668657 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:50.677825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:50.680455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:50.682102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-64e5ff27-c9dd-4ce8-b5bd-76e299d40576 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.204446 Jul 28 06:30:50.699479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 179/356] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:50 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:50.765836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] validate_networks() for [('fbbc8d74-4a13-4069-9d84-f85f9df7bdf6', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:30:51.301333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:51.304024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:51.311543 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:51.312194 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:51.313010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:51.318429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:51.533746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:30:51.534720 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:30:51.535354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:30:51.536123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:30:51.536974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:30:51.550428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:51.551436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:51.551664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:51.552223 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:51.561087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:51.572051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:30:51.572830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6522b067-5c8d-4623-ae67-49f33d5a9f6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.277091 Jul 28 06:30:51.573454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 180/357] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:51 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:51.577440 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:30:51.590870 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:30:51.593669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:30:51.715019 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:51.715019 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:51.715019 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:51.715743 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:51.716595 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:51.717043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:51.793413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dc96d944-f73f-43ca-a230-e0321c2b8649 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.616702 Jul 28 06:30:51.794665 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 178/358] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:30:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:30:51.807336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-78a4b836-2206-4856-a416-a50a2795f223 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:51.808574 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-78a4b836-2206-4856-a416-a50a2795f223 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:51.909283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-78a4b836-2206-4856-a416-a50a2795f223 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:51.923777 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:51.935286 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-78a4b836-2206-4856-a416-a50a2795f223 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1242 microversion: 2.1 time: 0.133029 Jul 28 06:30:51.936146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 179/359] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:51 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:51.936340 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:51.940646 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:51.942130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2be866bc-28af-4445-b136-ebf0f61afeb8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.240041 Jul 28 06:30:51.942876 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 181/360] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:51 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:52.594893 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:52.595515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:52.597961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:52.605650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:52.606183 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:52.607077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:52.607599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:52.632728 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:52.772303 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:52.780850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a0e43ff9-b9ad-48e2-97b8-b22880a4566e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.189290 Jul 28 06:30:52.782003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 180/361] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:52 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:52.957561 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:52.958920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:52.966883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:52.967505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:52.976848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:52.976848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:52.976848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:52.976848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:52.977258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:52.978255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:52.979068 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:52.979891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:53.090275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:53.097995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2bb4a1e5-0e68-4b93-b5c8-1a4a1b311d1e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1246 microversion: 2.1 time: 0.144384 Jul 28 06:30:53.098754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 182/362] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:52 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1246 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:53.207867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:53.217732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:53.219256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:53.220804 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9726e088-d249-4ca5-8709-615c7ccb1e47 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.259574 Jul 28 06:30:53.221654 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 181/363] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:52 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:53.803167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:53.804166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:53.811778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:53.812416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:53.813364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:53.813962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:53.976183 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:53.984670 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c84ae155-5717-4062-8c24-0cdf247a9790 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.185377 Jul 28 06:30:53.985242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 183/364] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:53 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:54.120203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:54.121705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:54.130041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:54.130794 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:54.131636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:54.132253 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:54.206803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:54.215359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-83ed8abb-57b9-4f53-b719-79af3e26699a tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1246 microversion: 2.1 time: 0.099484 Jul 28 06:30:54.215959 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 182/365] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:54 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:54.246518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:54.246772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:54.265721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:54.265721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:54.265721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:54.265721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:54.409848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:54.419580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:54.421465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:54.422682 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-508cc637-46c1-43b5-858f-070491cd1594 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.181304 Jul 28 06:30:54.423281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 184/366] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:54 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:55.005783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:55.006306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:55.012491 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:55.012932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:55.013716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:55.014145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:55.155656 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:55.163164 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cc4b8083-ba57-4b50-adc0-91a24bbe031b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.161350 Jul 28 06:30:55.177330 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 183/367] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:55 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:55.236125 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:55.236772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:55.243840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:55.244300 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:55.245153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:55.245589 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:55.324536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:55.332236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8f566f22-1fbd-413d-9e8b-f08043358e96 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1246 microversion: 2.1 time: 0.100003 Jul 28 06:30:55.332896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 185/368] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:55 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:55.446166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:55.447387 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:55.453297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:55.453771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:55.454515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:55.454942 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:55.586437 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:55.594939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:55.596439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:55.597626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-45ec01f4-66a8-4a74-8ce1-ad1c9eebf872 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.155399 Jul 28 06:30:55.598186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 184/369] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:55 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:56.185354 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:56.185985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:56.192391 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:56.192856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:56.193692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:56.194139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:56.333722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:56.343780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cd970492-e1a5-4c8e-9f60-880d15e06fbf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.162413 Jul 28 06:30:56.343965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 186/370] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:56 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:56.360133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:56.360874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:56.368598 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:56.368598 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:56.369441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:56.369876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:56.443039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:56.446017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b630357b-5f27-4e05-89db-c2abd7dbe392 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1246 microversion: 2.1 time: 0.089779 Jul 28 06:30:56.446706 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 185/371] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:56 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:56.621531 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:56.622475 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:56.630904 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:56.632296 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:56.633262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:56.635286 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:56.791283 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:56.799728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:56.801275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:56.802459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7237cc24-3288-409c-b006-6f41cc435df9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.186072 Jul 28 06:30:56.803058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 187/372] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:56 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:57.369505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:57.371368 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:57.381011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:57.382321 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:57.383364 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:57.384680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:57.467108 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:57.467844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:57.474411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:57.474937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:57.475766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:57.476294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:57.549839 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:57.557981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-08a54007-91ca-4307-9f57-a659eeffce56 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1294 microversion: 2.1 time: 0.094708 Jul 28 06:30:57.559311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 188/373] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:57 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:57.578134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:57.585737 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3355d1b0-3a71-4731-86cb-9beade1797c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.222612 Jul 28 06:30:57.586392 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 186/374] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:57 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:57.825294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:57.825928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:57.839791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:57.840374 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:57.841204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:57.841653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.004783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:58.014483 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:58.015999 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:58.017524 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7f9b958c-cf93-4069-b1e3-3742eaf06e2e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.196669 Jul 28 06:30:58.018147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 189/375] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:57 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:30:58.507663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-801599fc-d992-475b-a6b0-00bdafbc2107 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:30:58.514973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-801599fc-d992-475b-a6b0-00bdafbc2107 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.515415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-801599fc-d992-475b-a6b0-00bdafbc2107 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.580518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:58.581129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-801599fc-d992-475b-a6b0-00bdafbc2107 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Going to try to stop instance {{(pid=118388) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 06:30:58.581565 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:58.589408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.590032 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.590896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.591552 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.660028 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:58.663291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:30:58.668753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9f0d4089-1463-44ba-a8e2-efd85250f971 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1302 microversion: 2.1 time: 0.093090 Jul 28 06:30:58.669371 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 190/376] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:58 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:30:58.681747 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:58.681747 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:58.681747 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.682068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.683945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.683945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.863656 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-801599fc-d992-475b-a6b0-00bdafbc2107 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action" status: 202 len: 0 microversion: 2.1 time: 0.360099 Jul 28 06:30:58.866956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 187/377] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:30:58 2022] POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:30:58.874307 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:58.876808 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:58.889300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.891259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.892593 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:58.893866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:58.897984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:58.907178 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-710646cf-8da3-4a32-a527-79f31d21ce84 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.236691 Jul 28 06:30:58.907802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 191/378] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:58 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:59.046119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:59.047153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:59.053738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:59.054493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:59.056667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:59.057253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:59.115101 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:59.124461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-19b865b7-c139-4d43-b16d-738326c5271b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.254323 Jul 28 06:30:59.125038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 188/379] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:58 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:59.272775 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:59.284751 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:59.289235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:59.292562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-11ac7f2c-0e99-4cd2-9920-c8b3961c6f57 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.255077 Jul 28 06:30:59.294906 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 192/380] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:30:59 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:30:59.692707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:59.694040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:59.703123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:59.703905 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:59.707083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:59.707083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:59.789385 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:30:59.799868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1d6f452e-fc59-45b0-9188-fb62a28f165f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1300 microversion: 2.1 time: 0.112865 Jul 28 06:30:59.800542 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 189/381] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:59 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:30:59.928001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:30:59.928615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:30:59.936113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:59.936594 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:30:59.937623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:30:59.938110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:00.088257 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:00.096053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a3e00963-00f2-4243-a403-8728cd94a13b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.171816 Jul 28 06:31:00.096867 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 193/382] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:30:59 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:00.145858 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:00.146623 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:00.158284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:00.158980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:00.159987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:00.160567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:00.317689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:00.318300 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:00.328828 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:00.329828 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:00.330846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:00.331599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:00.358009 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:00.374248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fdfeff55-176a-4232-afa5-24411c59c081 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.232096 Jul 28 06:31:00.389901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 190/383] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:00 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:00.595987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:00.611782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:00.613764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:00.615538 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5eade9d3-056a-4237-8d60-e7a6a491cda6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1745 microversion: 2.20 time: 0.301837 Jul 28 06:31:00.616825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 194/384] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:00 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1745 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:00.821023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:00.822216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:00.829289 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:00.829951 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:00.831249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:00.831850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.033901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:01.047957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0a8b18ab-0732-46c8-9177-0aef94c9cce4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.227066 Jul 28 06:31:01.057402 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 191/385] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:00 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:01.128489 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:01.129223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:01.142637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.144662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.146661 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.147402 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.403078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:01.405104 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:01.416075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.416816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.420340 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.421926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.474641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:01.482961 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2ab969b-81d2-431f-877e-597e3347238c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.366427 Jul 28 06:31:01.483540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 195/386] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:01 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:01.563093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:01.640377 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:01.641241 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:01.655168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.655338 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:01.655970 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.657049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.657660 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.668114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e4df0551-b2d3-4daf-9b9c-ff5f970106d9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.269686 Jul 28 06:31:01.681357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 192/387] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:01 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:01.824192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-4f3e84f7-db74-47af-8e5f-52f66dd862af req-bb406bd9-f361-4116-8181-af6873f20dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3658bb5-2010-4828-b904-d276f960e32b", "tag": "5446b4de-3891-4dc5-914c-530482a1e17e"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:01.838427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-4f3e84f7-db74-47af-8e5f-52f66dd862af req-bb406bd9-f361-4116-8181-af6873f20dfa service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:01.840491 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-4f3e84f7-db74-47af-8e5f-52f66dd862af req-bb406bd9-f361-4116-8181-af6873f20dfa service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:01.857092 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-4f3e84f7-db74-47af-8e5f-52f66dd862af req-bb406bd9-f361-4116-8181-af6873f20dfa service nova] Creating event network-changed:5446b4de-3891-4dc5-914c-530482a1e17e for instance f3658bb5-2010-4828-b904-d276f960e32b on hv-cinder-81242 Jul 28 06:31:01.863406 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-4f3e84f7-db74-47af-8e5f-52f66dd862af req-bb406bd9-f361-4116-8181-af6873f20dfa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043218 Jul 28 06:31:01.864576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 193/388] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:31:02.077099 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:02.078427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:02.092008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=14 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:02.096285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:02.096751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:02.099405 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:02.100285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:02.414321 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:02.454540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:02.458702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:02.463160 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c5b9e5be-cbd9-4f2c-808c-cef633e171b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1745 microversion: 2.20 time: 0.826712 Jul 28 06:31:02.487788 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 196/389] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:01 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1745 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:02.504079 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:02.512319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:02.512319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:02.512904 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:02.513901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:02.514519 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:02.565229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:02.578086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7d01785a-8a78-460f-a608-2e1ea38061db tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.507018 Jul 28 06:31:02.579574 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 194/390] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:02 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:02.695577 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:02.696357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:02.708379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:02.709034 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:02.709920 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:02.710422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:02.922810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:02.933777 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a7c72517-1f70-4a8d-92d7-3e05a097ad0d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.433622 Jul 28 06:31:02.934860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 197/391] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:02 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:02.971742 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:02.983222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-33c16902-3ea2-4cb7-a319-b25c201e7840 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.292441 Jul 28 06:31:02.997588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 195/392] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:02 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:03.499774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:03.504789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:03.516863 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:03.520962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:03.523802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:03.526284 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:03.603004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:03.603670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:03.610134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:03.610587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:03.620121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:03.620609 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:03.851159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:03.866131 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:03.869132 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:03.870727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2ad3f809-69a4-4b37-905d-adf6a19a8b59 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.378391 Jul 28 06:31:03.871706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 198/393] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:03 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:03.887858 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-e029b590-0298-4019-9888-3725f58fd831 req-298bbde7-c090-4532-b120-585e095355be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "name": "network-vif-plugged", "status": "completed", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:03.920512 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e029b590-0298-4019-9888-3725f58fd831 req-298bbde7-c090-4532-b120-585e095355be service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:03.923756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e029b590-0298-4019-9888-3725f58fd831 req-298bbde7-c090-4532-b120-585e095355be service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:03.964141 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-e029b590-0298-4019-9888-3725f58fd831 req-298bbde7-c090-4532-b120-585e095355be service nova] Creating event network-vif-plugged:0d2efce0-28f9-47ea-a49a-15a80e72550a for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e on hv-cinder-81242 Jul 28 06:31:03.975811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:03.979090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-e029b590-0298-4019-9888-3725f58fd831 req-298bbde7-c090-4532-b120-585e095355be service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101562 Jul 28 06:31:03.979914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:03.982362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 199/394] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:03.992998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-35fd2bc8-8c7c-4516-81dc-3cf59fd367a6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.394560 Jul 28 06:31:03.996969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 196/395] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:03 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:04.002522 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:04.003353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:04.014910 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:04.014910 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:04.022820 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:04.023276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:04.024050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:04.024482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:04.029436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:04.029915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:04.030713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:04.031155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:04.270605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:04.285810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-98877c73-373b-47f0-9c37-4d5a255b281f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.302104 Jul 28 06:31:04.293572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:04.301716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 200/396] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:03 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:04.303362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7b2224e5-0fa2-4084-9679-8cf83037a08b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.298512 Jul 28 06:31:04.304601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 197/397] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:04 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:04.849693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-529214373", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "networks": [{"uuid": "50175450-6f2f-4aa2-9ede-88b996d979b0"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:04.898023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:04.898671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:04.910216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:04.914615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:04.916553 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:04.917919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:04.964238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] validate_networks() for [('50175450-6f2f-4aa2-9ede-88b996d979b0', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:31:05.249996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:05.270465 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:05.271845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:05.273262 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d4ab85e5-904b-419f-9ca8-b780ae635222 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.379633 Jul 28 06:31:05.275429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 198/398] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:04 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:05.293459 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:05.297240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:05.306216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:05.307026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:05.308165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:05.308970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:05.723185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:05.733914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ed565f91-d883-4ce5-ba4e-9991d8109445 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.456705 Jul 28 06:31:05.736025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 199/399] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:05 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:05.748518 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:05.751984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:05.772607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:05.773707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:05.776646 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:05.778389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:05.944471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:31:05.945572 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:31:05.946916 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:31:05.947961 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:31:05.948532 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:31:05.964431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:05.973669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:05.975738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:05.978314 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.034261 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Getting quotas for project f33d1845b3b643b99b066eaeee429e12. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:31:06.041292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Getting quotas for user 97547d56a8684009a794a42ad1c5f489 and project f33d1845b3b643b99b066eaeee429e12. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:31:06.079888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:31:06.082605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:31:06.149651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:06.157633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-933625e2-c0f1-4294-955c-5fb87836591a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.418701 Jul 28 06:31:06.170174 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 200/400] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:05 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:06.176714 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:06.177649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:06.185542 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.187466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.188606 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.189252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.277780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f7502614-0d6b-447a-bedc-1aa541d97e34 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423090 Jul 28 06:31:06.279295 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 201/401] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:31:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:31:06.294825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-d6cdfa2b-b91a-49f4-b621-4583220ff3b4 req-f44a27d2-a734-40aa-a031-6f8c6258ce69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "name": "network-vif-plugged", "status": "completed", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:06.311597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-d6cdfa2b-b91a-49f4-b621-4583220ff3b4 req-f44a27d2-a734-40aa-a031-6f8c6258ce69 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.312324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-d6cdfa2b-b91a-49f4-b621-4583220ff3b4 req-f44a27d2-a734-40aa-a031-6f8c6258ce69 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.330356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-d6cdfa2b-b91a-49f4-b621-4583220ff3b4 req-f44a27d2-a734-40aa-a031-6f8c6258ce69 service nova] Creating event network-vif-plugged:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:31:06.338377 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-d6cdfa2b-b91a-49f4-b621-4583220ff3b4 req-f44a27d2-a734-40aa-a031-6f8c6258ce69 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049708 Jul 28 06:31:06.345745 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 202/402] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:06.357772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9d063ba1-90bc-4355-acca-56173de473cc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:06.359025 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9d063ba1-90bc-4355-acca-56173de473cc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:06.496967 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9d063ba1-90bc-4355-acca-56173de473cc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:06.514889 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9d063ba1-90bc-4355-acca-56173de473cc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1218 microversion: 2.1 time: 0.167616 Jul 28 06:31:06.515501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 203/403] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:06 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:06.547285 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:06.547904 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:06.565766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.570887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:06.578327 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.579258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.579706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.596601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d5e5d7ca-7c1c-4981-9736-83e3e30c2432 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.410482 Jul 28 06:31:06.596601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 201/404] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:06 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:06.761921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:06.761921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:06.770660 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.771122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.771912 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:06.772345 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:06.940405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:06.968418 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:06.975420 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:06.976559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a86bfe6f-f123-4151-9562-4be0a9c94756 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.443114 Jul 28 06:31:06.978952 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 204/405] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:06 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:07.081600 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:07.091789 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3b401f57-0c1a-4dbe-b3b3-b99154a5e7d5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.340942 Jul 28 06:31:07.092985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 202/406] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:06 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:07.179543 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:07.180173 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:07.189121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:07.189719 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:07.190380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:07.190822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:07.390595 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:07.400733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bd4732c5-b28b-4845-9663-17d5eb211bef tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.224820 Jul 28 06:31:07.410088 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 205/407] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:07 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:07.536236 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-991d1a20-2ba1-42c9-a026-cc3408764344 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:07.536865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-991d1a20-2ba1-42c9-a026-cc3408764344 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:07.605176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-991d1a20-2ba1-42c9-a026-cc3408764344 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:07.610919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:07.611659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:07.613550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-991d1a20-2ba1-42c9-a026-cc3408764344 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1218 microversion: 2.1 time: 0.081040 Jul 28 06:31:07.616338 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 203/408] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:07 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:07.629368 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:07.630050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:07.630905 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:07.633637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:07.863675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:07.876804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-53b23cd3-a1a3-49d6-bdc7-e878804b17b8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.270251 Jul 28 06:31:07.878406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 206/409] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:07 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:08.018781 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:08.019564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:08.050476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.051240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.052332 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.054888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.116053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:08.262208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:08.262208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.262208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.262208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.263376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.403756 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:08.412520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:08.414135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:08.416152 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-03977680-1886-42cb-9b12-e24b717861f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.404263 Jul 28 06:31:08.416725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 204/410] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:08 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:08.422294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:08.423200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:08.430041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.431369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.432542 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.433197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.441517 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:08.453404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-37eb0b12-68d8-4b3e-a32a-80da7929d8e4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.342125 Jul 28 06:31:08.454191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 207/411] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:08 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:08.716271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:08.716271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-eaa6b310-9a61-4fa3-81e0-f63b653fe253 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1370 microversion: 2.1 time: 0.168555 Jul 28 06:31:08.716271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 205/412] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:08 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:08.717188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:08.717188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:08.717188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.717188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.717596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.717596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.717596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:08.723722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b863d40e-9175-4568-8862-879aa4b772dc tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1222 microversion: 2.1 time: 0.090204 Jul 28 06:31:08.724282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 208/413] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:08 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:08.904971 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:08.905702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:08.911813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.912265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:08.913090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:08.913726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.104080 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:09.114578 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e44d7a43-9a1b-48f2-a54e-92ebd4dfc456 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.213712 Jul 28 06:31:09.125651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 206/414] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:08 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:09.442169 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:09.442785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:09.456398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.456712 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.457549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.458035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.476454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:09.477957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:09.489837 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.494720 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.497983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.501243 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.786885 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:09.805564 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:09.827783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:09.834705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-978ebeb7-1284-4e5e-a8eb-96fb81a29443 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.392489 Jul 28 06:31:09.837923 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 209/415] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:09 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:09.847934 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:09.848706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:09.872992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.873672 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.874911 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.875606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.895678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:09.934923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:09.946866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9bc688ce-8e09-4b6d-a657-b148681b6133 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.474378 Jul 28 06:31:09.948296 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 207/416] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:09 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:09.959880 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:09.963423 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:09.978441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.978972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:09.979788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:09.980218 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.152761 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:10.160820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d68c8512-a5d5-4618-b9f0-f6249b88f853 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1214 microversion: 2.1 time: 0.211270 Jul 28 06:31:10.164235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 208/417] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:09 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:10.179572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-7f54b67a-c11e-479b-b95c-8709b2997e2e req-250494d7-903d-4227-b948-d62c8b3c1972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3658bb5-2010-4828-b904-d276f960e32b", "name": "network-vif-plugged", "status": "completed", "tag": "5446b4de-3891-4dc5-914c-530482a1e17e"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:10.211629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-7f54b67a-c11e-479b-b95c-8709b2997e2e req-250494d7-903d-4227-b948-d62c8b3c1972 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.216193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-7f54b67a-c11e-479b-b95c-8709b2997e2e req-250494d7-903d-4227-b948-d62c8b3c1972 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.236588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:10.250044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eeddb59d-738e-497b-a087-f8a936f80a50 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1564 microversion: 2.1 time: 0.412157 Jul 28 06:31:10.251245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 210/418] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:09 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1564 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:10.258913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-7f54b67a-c11e-479b-b95c-8709b2997e2e req-250494d7-903d-4227-b948-d62c8b3c1972 service nova] Creating event network-vif-plugged:5446b4de-3891-4dc5-914c-530482a1e17e for instance f3658bb5-2010-4828-b904-d276f960e32b on hv-cinder-81242 Jul 28 06:31:10.264944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:10.265591 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:10.274841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-7f54b67a-c11e-479b-b95c-8709b2997e2e req-250494d7-903d-4227-b948-d62c8b3c1972 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106240 Jul 28 06:31:10.280287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 209/419] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:10.285789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.288561 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.289635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.292021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:10.292575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.297479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:10.317472 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.318284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.319859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.322141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.581104 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8b43406d-ff3b-43ed-8a1c-7e021d2b1bd5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.299048 Jul 28 06:31:10.581832 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 210/420] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:31:10 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:10.756621 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:10.772272 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7adff104-c5ec-4630-b69e-60f3067a8c73 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.512957 Jul 28 06:31:10.773673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 211/421] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:10 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:10.861911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:10.861911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:10.879987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.880213 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.881191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.881809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.969619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:10.970228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:10.981517 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.982102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:10.982731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:10.983164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:11.857289 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:11.870299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:11.877362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:11.878913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bb58095d-6fa9-4bf2-812e-c458b7aa86bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 1.021969 Jul 28 06:31:11.879704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 211/422] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:10 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:11.885153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:11.886711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:11.893498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:11.894203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:11.895163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:11.895766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:12.076130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:12.090176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b55b3a5c-d75f-4e11-8f6f-d57a116b4dfd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1276 microversion: 2.1 time: 0.209224 Jul 28 06:31:12.090768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 212/423] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:11 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:12.109009 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:12.109675 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:12.127913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:12.130291 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:12.131314 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:12.132000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:12.253996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:12.276938 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f38bc559-1a98-45df-a4c6-46fd96e6f679 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 1.303402 Jul 28 06:31:12.278002 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 212/424] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:10 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:12.875885 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:12.906586 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:12.910100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:12.912440 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3201dcde-200a-4e39-83b6-3c4852f1cc10 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.807320 Jul 28 06:31:12.917100 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 213/425] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:12 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:12.931536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:12.932564 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:12.933896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:12.935710 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:13.114373 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:13.115611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:13.146596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:13.154262 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:13.156017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:13.163449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:13.739326 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:13.754766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3f474795-3e25-42f3-99d9-8b073283da7d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1276 microversion: 2.1 time: 0.639637 Jul 28 06:31:13.755435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 214/426] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:13 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1276 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:13.765744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:13.769116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:13.793188 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:13.795255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:13.796953 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:13.798003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:13.846972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:14.420005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:14.432796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b51fb5c3-d756-4268-9ed7-d2d6d79da517 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1368 microversion: 2.1 time: 0.674401 Jul 28 06:31:14.435654 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 215/427] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:13 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1368 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:14.453862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:14.455603 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:14.468625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:14.469476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:14.471991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:14.472709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:14.688062 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:14.703073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:14.712134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:14.715064 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-556bc7b8-2fcc-441c-adbf-b99e96ef6f55 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 1.811975 Jul 28 06:31:14.725678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 213/428] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:12 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:14.784229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:14.793254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:14.793254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:14.794198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:14.794947 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:14.797175 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:14.797901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:14.966317 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:14.980372 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6faf9359-59f1-4b2f-bdc8-d6e8dcd1e342 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.543185 Jul 28 06:31:14.984378 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 216/429] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:14 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:15.463242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:15.463913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:15.480572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:15.481347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:15.482239 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:15.482684 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:15.742082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:15.754922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-999581ed-265d-4f0a-9bc6-48b89dd90700 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1276 microversion: 2.1 time: 0.974499 Jul 28 06:31:15.766882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 214/430] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:14 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1276 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:15.787312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:15.788869 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:15.798171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:15.800365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:15.801777 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:15.803582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:16.000410 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:16.139981 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:16.153717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d8b85ace-f72b-415c-813e-97601de0eae0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1558 microversion: 2.1 time: 0.698202 Jul 28 06:31:16.153717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 217/431] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:15 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1558 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:16.174065 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:16.175501 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:16.188408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:16.189269 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:16.190435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:16.193063 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:16.478942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:16.488630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:16.545633 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:16.554722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7a425a16-8717-4980-8d7c-805e0aa6338c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.772702 Jul 28 06:31:16.557900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 215/432] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:15 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:16.583534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:16.584787 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:16.592098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=8 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:16.595415 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:16.596081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:16.598038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:16.598645 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:16.952873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d0d6f4e5-f3ae-4bf5-b6c1-e68716162c97 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.374468 Jul 28 06:31:16.954725 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 216/433] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:31:16 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/os-interface => generated 284 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:16.976438 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:16.982709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:16.997979 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:16.998706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:17.005254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:17.009520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:17.032803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:17.048746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-16279761-f840-478d-9921-b6b0112789c0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.877934 Jul 28 06:31:17.050851 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 218/434] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:16 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:17.397221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-38361948-972d-4211-8732-8255deff4757 req-ffa877ac-2d58-4188-9c8f-aa7c1b962148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:17.434580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-38361948-972d-4211-8732-8255deff4757 req-ffa877ac-2d58-4188-9c8f-aa7c1b962148 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:17.435043 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-38361948-972d-4211-8732-8255deff4757 req-ffa877ac-2d58-4188-9c8f-aa7c1b962148 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:17.485010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-38361948-972d-4211-8732-8255deff4757 req-ffa877ac-2d58-4188-9c8f-aa7c1b962148 service nova] Creating event network-changed:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:31:17.510132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-38361948-972d-4211-8732-8255deff4757 req-ffa877ac-2d58-4188-9c8f-aa7c1b962148 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115293 Jul 28 06:31:17.513412 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 219/435] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:17.550480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:17.559463 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8cade367-c10a-4d0f-81ba-de978f1a313e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.601881 Jul 28 06:31:17.562227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 217/436] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:16 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:17.586084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:17.586809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:17.613172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:17.621132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:17.621659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:17.627429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:17.630252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:18.075338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:18.077705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:18.095386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:18.104804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:18.104804 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:18.106016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:20.013988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:20.027542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0a5a3ee9-5427-41ab-ae2d-d6376a8891d0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 1.956899 Jul 28 06:31:20.030039 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 218/437] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:18 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:20.036615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:20.037611 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:20.076502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:20.077398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:20.080992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:20.081671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:20.089055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:20.103582 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:20.112984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:20.114269 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7bf78d0a-8520-419d-9ab7-f3590f958af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 2.532811 Jul 28 06:31:20.114855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 220/438] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:17 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:20.870394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:20.883765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-784b7dd2-466d-4644-a9b2-f0cf78d74707 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.851089 Jul 28 06:31:20.890338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 219/439] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:20 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:21.063597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:21.065617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:21.083743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.084632 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.087123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.088188 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.141746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:21.142359 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:21.158783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.159836 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.162641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.163089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.466649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:21.476762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-26c81834-bbf4-47e5-b45c-2727e5b507cc tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.430315 Jul 28 06:31:21.501461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 221/440] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:21 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:21.522148 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-5096e24c-fd32-454c-b98b-ded0915a72c0 req-a6aae6b1-73fb-4f2d-b162-f2517588175d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8486067-5ab6-483a-84c4-8d4eb4f1b07e", "tag": "f10204df-a4f7-4635-be5a-4e54d32ca919"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:21.543210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-5096e24c-fd32-454c-b98b-ded0915a72c0 req-a6aae6b1-73fb-4f2d-b162-f2517588175d service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.550534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-5096e24c-fd32-454c-b98b-ded0915a72c0 req-a6aae6b1-73fb-4f2d-b162-f2517588175d service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.570762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:21.582121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-5096e24c-fd32-454c-b98b-ded0915a72c0 req-a6aae6b1-73fb-4f2d-b162-f2517588175d service nova] Creating event network-changed:f10204df-a4f7-4635-be5a-4e54d32ca919 for instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e on hv-cinder-81242 Jul 28 06:31:21.596712 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-5096e24c-fd32-454c-b98b-ded0915a72c0 req-a6aae6b1-73fb-4f2d-b162-f2517588175d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093267 Jul 28 06:31:21.597202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:21.599529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:21.601069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d275397c-695c-4f4f-955e-b161cc213071 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.466444 Jul 28 06:31:21.602384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 222/441] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:21.605637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 220/442] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:21 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:21.609811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-f70b8b4c-b0e7-4d0d-8e92-691265f309c4 req-67bafe91-1058-4ae3-8513-c7c6c09b9584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3658bb5-2010-4828-b904-d276f960e32b", "tag": "5446b4de-3891-4dc5-914c-530482a1e17e"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:21.620668 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-f70b8b4c-b0e7-4d0d-8e92-691265f309c4 req-67bafe91-1058-4ae3-8513-c7c6c09b9584 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.621492 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-f70b8b4c-b0e7-4d0d-8e92-691265f309c4 req-67bafe91-1058-4ae3-8513-c7c6c09b9584 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.634892 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-f70b8b4c-b0e7-4d0d-8e92-691265f309c4 req-67bafe91-1058-4ae3-8513-c7c6c09b9584 service nova] Creating event network-changed:5446b4de-3891-4dc5-914c-530482a1e17e for instance f3658bb5-2010-4828-b904-d276f960e32b on hv-cinder-81242 Jul 28 06:31:21.642144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-f70b8b4c-b0e7-4d0d-8e92-691265f309c4 req-67bafe91-1058-4ae3-8513-c7c6c09b9584 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037444 Jul 28 06:31:21.643485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 223/443] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:21.928034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:21.930216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:21.953184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.953184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:21.953184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:21.953184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:22.508028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:22.510320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:22.526382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:22.528135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:22.529862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:22.534791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:22.744405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:22.756530 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e23bcb4a-af12-4ef9-91d8-3f3dab926abe tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.843428 Jul 28 06:31:22.759759 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 221/444] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:21 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:22.765235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:22.779005 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:22.795056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:22.798524 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:22.801544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:22.802179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:23.099187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:23.111901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-29af500e-76a6-44f5-991d-d46f5aba70c2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.608603 Jul 28 06:31:23.113185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 224/445] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:22 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:23.266950 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:23.307511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:23.309851 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:23.311628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-73f36bd6-20bf-4d3c-85fb-03267c46bd43 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.550529 Jul 28 06:31:23.312424 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 222/446] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:22 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:23.784263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:23.784885 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:23.793974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:23.795369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:23.796206 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:23.796648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:23.986345 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:24.003934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2937dd40-3cbe-4959-b378-06a8d32b872f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.225125 Jul 28 06:31:24.018342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 225/447] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:23 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:24.135382 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:24.136050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:24.151015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:24.151015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:24.151015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:24.151015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:24.340084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:24.340698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:24.343118 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=94 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:24.358446 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:24.359191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:24.360198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:24.360791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:24.450870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:24.467638 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-569a8b63-b51a-45cd-b0b4-8ed882312d74 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1722 microversion: 2.1 time: 0.336603 Jul 28 06:31:24.473408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 223/448] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:24 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:24.891998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:24.905181 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:24.907420 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:24.908900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-45c45b1f-14b4-4162-ac3c-675ea95213dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.574477 Jul 28 06:31:24.921335 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 226/449] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:24 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:25.034174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.034784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:25.043900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.044741 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:25.045797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.047759 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:25.494838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.497395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:25.544386 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.545084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:25.546005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.554045 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:25.811610 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:25.825636 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-66fc0ad5-c024-4200-85da-ff7437b06b8d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.796828 Jul 28 06:31:25.827550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 224/450] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:25.869176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:25.883054 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1ec312d3-b44a-417c-9ec3-4d6dc60250cb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1699 microversion: 2.1 time: 0.394599 Jul 28 06:31:25.887645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 227/451] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1699 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:25.910915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01a870ac-2a26-445e-b08c-587cdd39dd7f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:25.920590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01a870ac-2a26-445e-b08c-587cdd39dd7f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.921911 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01a870ac-2a26-445e-b08c-587cdd39dd7f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:25.938667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:25.943906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:25.952751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.956496 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:25.959129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:25.962813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:26.085229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-01a870ac-2a26-445e-b08c-587cdd39dd7f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Going to try to start instance {{(pid=118387) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 06:31:26.250143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:26.260340 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:26.262170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:26.263407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8a9a99bf-3fc2-4e32-899f-20cb0e40f816 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1740 microversion: 2.20 time: 0.329489 Jul 28 06:31:26.263962 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 228/452] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:25 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:26.407366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-01a870ac-2a26-445e-b08c-587cdd39dd7f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action" status: 202 len: 0 microversion: 2.1 time: 0.499368 Jul 28 06:31:26.408636 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 225/453] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:31:25 2022] POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:31:26.420755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:26.424535 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:26.437544 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:26.438020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:26.438799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:26.439246 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:26.849862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:26.850586 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:26.860179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:26.860624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:26.861608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:26.862049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:26.880156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:27.183167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:27.198044 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cc26ef16-377d-460c-9733-eba0d8f0130e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1708 microversion: 2.1 time: 0.778851 Jul 28 06:31:27.200566 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 229/454] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:26 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1708 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:27.287645 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:27.291135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:27.295061 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:27.307818 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fdb7430f-618f-4a33-bb1e-65e1912ff617 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.462622 Jul 28 06:31:27.315467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:27.315941 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:27.337645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:27.338662 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:27.355164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 226/455] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:26 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:27.782713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:27.838472 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:27.846057 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:27.848848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-04864544-3d9e-4e19-91d2-5d161fdb2819 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1722 microversion: 2.20 time: 0.564519 Jul 28 06:31:27.852932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 230/456] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:27 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1722 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:28.222896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:28.223598 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:28.230795 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:28.231585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:28.232918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:28.234230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:28.347085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:28.347733 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:28.356378 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:28.358016 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:28.359333 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:28.359994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:28.677581 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:28.686553 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-27d8c885-0240-4779-bf29-8ad0995a877e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1708 microversion: 2.1 time: 0.467891 Jul 28 06:31:28.687133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 227/457] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:28 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1708 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:28.706844 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:28.714990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-07310e4d-07ac-4529-97e7-c25f74912eaf tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.372193 Jul 28 06:31:28.719681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 231/458] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:28 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:28.884171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:28.884985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:28.892937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:28.893422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:28.896046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:28.896531 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:29.067555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:29.078901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:29.080391 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:29.081870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d570f904-a484-481a-9382-6a9939f7f285 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1722 microversion: 2.20 time: 0.202138 Jul 28 06:31:29.082635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 228/459] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:28 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:29.708116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:29.708912 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:29.720361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:29.720361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:29.720361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:29.720361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:29.738695 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:29.742544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:29.755315 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:29.755770 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:29.756545 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:29.756981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:29.969774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:29.974342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-98ca285d-7fe7-4659-b280-661e6b2df061 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1708 microversion: 2.1 time: 0.270238 Jul 28 06:31:29.986627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:29.991658 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2d1f533c-6767-4bdb-af25-d93033a5efe5 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.256411 Jul 28 06:31:29.992512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 232/460] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:29 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1708 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:30.006320 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 229/461] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:29 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:30.107425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:30.108265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:30.114870 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:30.115450 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:30.116331 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:30.117126 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:30.421332 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:30.430129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:30.432540 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:30.438811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8fa19a50-4d15-491a-b9a7-71f4846d4a27 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1722 microversion: 2.20 time: 0.332393 Jul 28 06:31:30.438811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 233/462] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:30 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:30.484026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-efb8fa72-6c1c-4275-9ff6-6b58ff849145 req-3f83b073-bb0d-4237-9bdb-a2a8a68082c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8486067-5ab6-483a-84c4-8d4eb4f1b07e", "name": "network-vif-plugged", "status": "completed", "tag": "f10204df-a4f7-4635-be5a-4e54d32ca919"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:30.494560 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-efb8fa72-6c1c-4275-9ff6-6b58ff849145 req-3f83b073-bb0d-4237-9bdb-a2a8a68082c1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:30.495149 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-efb8fa72-6c1c-4275-9ff6-6b58ff849145 req-3f83b073-bb0d-4237-9bdb-a2a8a68082c1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:30.507737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-efb8fa72-6c1c-4275-9ff6-6b58ff849145 req-3f83b073-bb0d-4237-9bdb-a2a8a68082c1 service nova] Creating event network-vif-plugged:f10204df-a4f7-4635-be5a-4e54d32ca919 for instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e on hv-cinder-81242 Jul 28 06:31:30.518990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-efb8fa72-6c1c-4275-9ff6-6b58ff849145 req-3f83b073-bb0d-4237-9bdb-a2a8a68082c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Jul 28 06:31:30.518990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 230/463] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:31.000517 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:31.001756 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:31.014051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:31.015201 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:31.020460 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:31.020915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:31.021760 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:31.022356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:31.035013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:31.035474 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:31.036273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:31.038386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:31.045348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:31.383144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:31.386991 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:31.406225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bb9fa390-6644-46f5-8611-92f8988ec2bd tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.397466 Jul 28 06:31:31.414690 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-def13ab4-c8e5-49f3-80c0-e640c345cd66 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1708 microversion: 2.1 time: 0.417567 Jul 28 06:31:31.416006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 234/465] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:30 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1708 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:31.416178 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 231/465] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:31 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:31:31.460953 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:31.463783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:31.483245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:31.483245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:31.483245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:31.483245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:31.955996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:31.966010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:31.967604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:31.968938 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6ee5456f-2cf1-432b-aaf7-7ec204be3e68 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1725 microversion: 2.20 time: 0.515028 Jul 28 06:31:31.969835 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 232/466] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:31 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1725 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:31.995354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e093260b-4719-4d61-8e26-e24c463e7b4c"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:31.998004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:32.007098 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.007717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.008457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.009997 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.428218 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:32.428844 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:32.436800 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.437251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.438067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.438511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.675398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:32.693675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-24f7d1d9-c4bf-4d3d-ae22-4b216ab2cd60 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.268168 Jul 28 06:31:32.712533 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 233/467] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:32 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:32.719988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:32.720990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:32.733989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.734826 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.735852 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.736607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.944749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:32.956280 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a842d8a8-15ff-4e46-9f0e-2e46f08fedd3 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1712 microversion: 2.1 time: 0.242050 Jul 28 06:31:32.957221 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 234/468] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:32 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1712 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:32.968360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-328c7000-b3e6-459f-a6f4-39e2a1c69b6d req-107810cf-6db1-4474-9706-f4243bb5927f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "name": "network-vif-unplugged", "status": "completed", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:32.981215 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-328c7000-b3e6-459f-a6f4-39e2a1c69b6d req-107810cf-6db1-4474-9706-f4243bb5927f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:32.981874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-328c7000-b3e6-459f-a6f4-39e2a1c69b6d req-107810cf-6db1-4474-9706-f4243bb5927f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:32.994703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.compute.server_external_events [req-328c7000-b3e6-459f-a6f4-39e2a1c69b6d req-107810cf-6db1-4474-9706-f4243bb5927f service nova] Unable to find a host for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e. Dropping event network-vif-unplugged {{(pid=118387) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 06:31:32.995714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-328c7000-b3e6-459f-a6f4-39e2a1c69b6d req-107810cf-6db1-4474-9706-f4243bb5927f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037215 Jul 28 06:31:32.996431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 235/469] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 06:31:33.291185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea9b1a6e-02db-46f6-ab69-0d085e2e9a33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Action: 'create', calling method: .version_select at 0x7fbe625deaf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-251647084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2ch1oV0Ww0XC/xY/B00zIfpak3BEWOz6KGPA/p7VNkcZP9TroWZn6pnaQaugTStufkdTWesB2hMb5F01MjCQyOnEnjb/LeRbnc0aRz01o2HYrQFqnmaH/7KI/1fBXBJg=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:33.307721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-ea9b1a6e-02db-46f6-ab69-0d085e2e9a33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for project 47b406d9a12c461a84aa0331d2890990. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:31:33.312108 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-ea9b1a6e-02db-46f6-ab69-0d085e2e9a33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for user b1868c7d0ec8443b9ccb698ee02928b6 and project 47b406d9a12c461a84aa0331d2890990. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:31:33.347512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9a8d8213-6287-4ac7-9b97-34f6f0449130 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.353777 Jul 28 06:31:33.347512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 235/470] 10.222.0.69 () {62 vars in 1364 bytes} [Thu Jul 28 06:31:31 2022] POST /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments => generated 188 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:31:33.423204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea9b1a6e-02db-46f6-ab69-0d085e2e9a33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.334360 Jul 28 06:31:33.423204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 236/471] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:31:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:33.491113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:33.491965 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:33.500108 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:33.500541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:33.501328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:33.501857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:33.557558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118388) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 06:31:33.720987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:33.721738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:33.729654 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:33.730400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:33.731453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:33.731892 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:33.884450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:33.892535 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ca372483-0622-4481-9ea7-2cfa946a2885 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1318 microversion: 2.1 time: 0.176192 Jul 28 06:31:33.897788 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 237/472] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:33 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:33.934201 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c7a3a60a-37ff-4762-b90c-7ae4af6cbc6d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/action" status: 202 len: 0 microversion: 2.20 time: 0.447689 Jul 28 06:31:33.934815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 236/473] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Jul 28 06:31:33 2022] POST /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:31:33.943094 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:33.943692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:33.950832 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:33.951281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:33.952233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:33.953034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:34.107274 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:34.117488 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:34.119089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:34.120423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8676471-f816-46e5-93c0-629660267407 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1751 microversion: 2.20 time: 0.181162 Jul 28 06:31:34.120978 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 238/474] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:33 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:34.914709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:34.915469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:34.923233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:34.923686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:34.924463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:34.924996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:35.118799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:35.143918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:35.144569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:35.155450 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4a372e36-1611-4719-ac62-aba5180102e9 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1506 microversion: 2.1 time: 0.245436 Jul 28 06:31:35.162190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:35.162771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 237/475] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:31:34 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:31:35.163405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:35.164373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:35.165002 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:35.429428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:35.450164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:35.453042 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:35.459746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a67696c4-b8a8-464e-9ed0-28965c024c35 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1751 microversion: 2.20 time: 0.316980 Jul 28 06:31:35.475757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 239/476] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:35 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1751 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:36.487456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:36.488145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:36.496646 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:36.497183 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:36.498315 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:36.498860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:36.666603 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:36.675721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:36.679293 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:36.681163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-62f312d2-70a9-4f19-82f5-21ffd6718e26 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1753 microversion: 2.20 time: 0.197038 Jul 28 06:31:36.681950 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 238/477] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:36 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:37.705714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:37.706335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:37.714203 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:37.714729 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:37.715510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:37.716011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:37.868222 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:37.878164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:37.880606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:37.881895 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c7af27c2-facc-412c-9e37-8dc5b29bdb10 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1753 microversion: 2.20 time: 0.180401 Jul 28 06:31:37.882483 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 240/478] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:37 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:38.904644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:38.905459 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:38.912768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:38.913312 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:38.916692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:38.916692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:39.124074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:39.133986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:39.136603 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:39.137844 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-762bd45d-0592-4570-81ec-77560eb52544 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.237692 Jul 28 06:31:39.138413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 239/479] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:38 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:40.161254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:40.162319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:40.169277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:40.169744 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:40.170510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:40.170942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:40.323346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:40.331977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:40.333500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:40.334659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1074f0fb-8f65-48ad-983e-686f24899476 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.177618 Jul 28 06:31:40.335210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 241/480] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:40 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:41.359976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:41.360680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:41.368015 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:41.368433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:41.370163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:41.370873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:41.513686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:41.522221 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:41.523733 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:41.524903 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-142877bf-97b1-41e9-bbbb-1d13a7bcfc09 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.168885 Jul 28 06:31:41.526153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 240/481] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:41 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:42.548872 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:42.549508 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:42.556868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:42.557670 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:42.558611 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:42.559287 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:42.693939 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:42.702487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:42.703977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:42.705126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a0ea253e-05ab-4d6b-897a-3283f0a2426d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.160492 Jul 28 06:31:42.705710 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 242/482] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:42 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:43.729070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:43.729813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:43.737023 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:43.737791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:43.738571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:43.739010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:43.879894 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:43.889480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:43.891165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:43.892886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c2003eed-f707-4e67-93ff-3fc9433b3e48 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.167444 Jul 28 06:31:43.893481 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 241/483] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:43 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:44.916516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:44.917134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:44.919369 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:44.925152 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:44.925641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:44.926417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:44.936784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:45.077129 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:45.086343 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:45.089111 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:45.090766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0ccb85d6-c99e-4ae3-8bb5-0ff3d2364b8e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.178658 Jul 28 06:31:45.101712 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 243/484] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:44 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:46.114975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:46.115642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:46.124377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:46.124846 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:46.125680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:46.126118 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:46.268195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:46.277334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:46.278852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:46.280011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-11a3aca9-e2cd-44e3-9eca-bd44521c3aed tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.168943 Jul 28 06:31:46.280570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 242/485] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:46 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:47.304034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:47.304678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:47.312830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:47.318293 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:47.318943 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:47.320305 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:47.321036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:47.562483 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:47.572563 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:47.574955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:47.576262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a7e687a5-3067-47d8-b389-700b554004d4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.276144 Jul 28 06:31:47.577048 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 244/486] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:47 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:48.600025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:48.600642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:48.607684 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:48.609718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:48.609718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:48.609718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:48.746530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:48.758308 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:48.760868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:48.762112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-195f7102-7305-4c0b-8ac2-d421945cbd18 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.165992 Jul 28 06:31:48.762673 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 243/487] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:48 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:49.532534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd931a90-8726-46c3-9227-dc2ba1ebf160"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:31:49.535059 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:49.542616 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:49.543067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:49.543851 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:49.544293 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:49.559638 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:49.786878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:49.787549 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:49.794841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:49.795295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:49.796076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:49.796817 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:49.945336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:49.954807 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:49.959391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:49.959391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-00916315-1f71-4119-91e3-e6df3e3d9ea6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.174660 Jul 28 06:31:49.959391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 244/488] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:49 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:50.346251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cbe7afd8-251d-4526-9ed6-1c47ec13ba41 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817580 Jul 28 06:31:50.358326 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 245/489] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:31:49 2022] POST /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:31:50.981357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:50.982141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:50.988633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:50.989084 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:50.990077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:50.990517 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:51.147130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:51.155785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:51.157284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:51.158478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f58f3d97-9f5e-4bf5-9f22-2ccf1804f81f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.181315 Jul 28 06:31:51.159063 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 245/490] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:50 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:31:52.185279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:52.185927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:52.192739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:52.193195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:52.193996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:52.194438 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:52.333666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:52.342731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:52.344648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:52.346208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d214951a-55c6-48e3-9844-76d9305f76dc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.166559 Jul 28 06:31:52.356723 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 246/491] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:52 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:53.370729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:53.371337 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:53.378155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:53.378588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:53.379351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:53.379782 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:53.529010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:53.537818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:53.539337 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:53.540520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-614ea0f1-dc64-4707-b6d1-88acbcaba71b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.174565 Jul 28 06:31:53.541080 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 246/492] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:53 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:54.564669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:54.565287 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:54.572647 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:54.573101 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:54.573910 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:54.574475 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:54.721228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:54.730261 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:54.731752 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:54.732902 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f6faee63-1ee1-4880-9a85-4b3efeab6b9b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.172236 Jul 28 06:31:54.733478 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 247/493] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:54 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:55.755635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:55.756242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:55.758669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:55.764436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:55.764970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:55.765775 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:55.766210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:55.768972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:31:55.904650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:55.913014 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:55.914557 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:55.916207 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ddfbf7e2-ae2e-4376-b524-085edce90fa1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.163922 Jul 28 06:31:55.916964 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 247/494] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:55 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:56.940845 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:56.941407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:56.948165 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:56.948615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:56.949415 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:56.949859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:57.081520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:57.091130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:57.092628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:57.093815 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6bf73910-af5b-451f-8336-19a8e895ee32 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.157113 Jul 28 06:31:57.099276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 248/495] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:56 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:58.121424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:58.122646 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:58.128729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:58.131433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:58.131433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:58.131433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:58.281427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:58.293732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:58.295077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:58.296495 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-619e8a2d-ec03-477c-b53c-1f311ad8a8d8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.179232 Jul 28 06:31:58.297075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 248/496] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:58 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:31:59.331628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:31:59.333182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:31:59.343220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:59.348546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:59.348546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:31:59.348546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:31:59.501403 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:59.510729 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:59.512609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:31:59.513980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-618c83b9-ceac-41f6-b4cf-7a3dce62f6bf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.189276 Jul 28 06:31:59.514556 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 249/497] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:31:59 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:32:00.537685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:00.538541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:00.545283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:00.552741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:00.553711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:00.554229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:00.693927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:00.702833 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:00.704371 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:00.705719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-99e52ce0-0121-4ac5-89b9-68e2a626db4f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.171850 Jul 28 06:32:00.706286 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 249/498] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:00 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:01.729638 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:01.731466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:01.739482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:01.740187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:01.740966 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:01.741921 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:01.884709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:01.894739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:01.896504 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:01.897835 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cea34f51-3a97-4cb5-8d39-ac8cf0dc9a83 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.172918 Jul 28 06:32:01.898407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 250/499] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:01 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:02.922138 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:02.922734 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:02.929217 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:02.929697 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:02.930453 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:02.930887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:03.082074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:03.095039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:03.096694 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:03.098036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dc57d187-9084-489c-af37-cc5def2b3408 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.179822 Jul 28 06:32:03.098906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 250/500] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:02 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:04.019379 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:04.019983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:04.026744 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.027197 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.027967 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.028412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.051610 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bbc26b63-04e7-43de-baa9-5536af8fb85f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/ips" status: 200 len: 149 microversion: 2.1 time: 0.036249 Jul 28 06:32:04.052242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 251/501] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:32:04 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:04.064227 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a71c0625-896f-4a13-8732-a9aa49946052"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:04.066983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:04.081956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.082686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.083481 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.083920 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.121994 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:04.123052 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:04.132671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.134867 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.138240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.138884 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.187563 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Invalid volume: volume a71c0625-896f-4a13-8732-a9aa49946052 is already attached to instances: b394488f-cd75-46c4-b399-909d7bd808fa Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: POST /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/os-volume_attachments HTTP/1.1 Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 74 Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:32:04.189107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {"volumeAttachment": {"volumeId": "a71c0625-896f-4a13-8732-a9aa49946052"}} Jul 28 06:32:04.190482 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Invalid volume: volume a71c0625-896f-4a13-8732-a9aa49946052 is already attached to instances: b394488f-cd75-46c4-b399-909d7bd808fa Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'server_id': 'f3658bb5-2010-4828-b904-d276f960e32b', 'body': {'volumeAttachment': {'volumeId': 'a71c0625-896f-4a13-8732-a9aa49946052'}}} Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a71c0625-896f-4a13-8732-a9aa49946052 is already attached to instances: b394488f-cd75-46c4-b399-909d7bd808fa Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:04.191256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a71c0625-896f-4a13-8732-a9aa49946052 is already attached to instances: b394488f-cd75-46c4-b399-909d7bd808fa Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:04.192645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a71c0625-896f-4a13-8732-a9aa49946052 is already attached to instances: b394488f-cd75-46c4-b399-909d7bd808fa Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 400 to user: Invalid volume: volume a71c0625-896f-4a13-8732-a9aa49946052 is already attached to instances: b394488f-cd75-46c4-b399-909d7bd808fa {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:32:04.195883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-231f9a25-55a1-4991-bea2-d89ac8162f33 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.130298 Jul 28 06:32:04.196878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 251/502] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:32:04 2022] POST /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:32:04.201015 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:04.201535 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:04.212663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.213112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.214165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.214601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.255306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:32:04.297126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:04.310613 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:04.312220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:04.313625 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f977569a-d7a5-49de-92e7-7696c292fa45 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.196283 Jul 28 06:32:04.314388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 252/503] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:04 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:32:04.630787 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d1365864-85f4-43c1-aae9-00dd10028908 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 204 len: 0 microversion: 2.1 time: 0.433200 Jul 28 06:32:04.631290 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 252/504] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:32:04 2022] DELETE /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:32:04.639605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:04.640225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:04.646676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.647172 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.648055 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:04.648513 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:04.790015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:04.798303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2c1cf04d-c548-41e5-af73-c6b9b96787a0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.162673 Jul 28 06:32:04.813385 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 253/505] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:04 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:05.336916 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:05.337918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:05.345217 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:05.345757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:05.346570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:05.347012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:05.487651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:05.505127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:05.507313 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:05.508884 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-477836cc-4b4e-42a3-ac4c-809cf65988e1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.176276 Jul 28 06:32:05.510820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 253/506] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:05 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:05.822449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:05.823864 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:05.831243 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:05.831749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:05.832566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:05.832998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:05.970587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:05.977984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d5e02319-95c0-4c4c-b086-78b549f72772 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.160869 Jul 28 06:32:05.978550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 254/507] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:05 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:06.533187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:06.534336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:06.552783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:06.560677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:06.560677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:06.560677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:06.699963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:06.708760 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:06.710326 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:06.711507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f08e4d01-d72a-42a3-97fe-89c85b470275 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.183398 Jul 28 06:32:06.712324 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 254/508] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:06 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:07.000555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:07.001163 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:07.007618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:07.008058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:07.008811 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:07.009239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:07.150166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:07.159754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-88f6053c-80c3-4e09-8259-c342d42c9477 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.162682 Jul 28 06:32:07.160417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 255/509] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:06 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:07.736540 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:07.737141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:07.744650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:07.745092 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:07.745885 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:07.746316 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:07.893777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:07.904172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:07.905815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:07.906969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1b44b106-c724-48b7-a0f5-f85ec20b2237 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.175180 Jul 28 06:32:07.907773 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 255/510] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:07 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:08.182241 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:08.183506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:08.190657 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:08.191110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:08.192074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:08.192705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:08.350022 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:08.358228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea42092c-e265-4cfe-a319-6bf0c6a3c1cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.180108 Jul 28 06:32:08.358799 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 256/511] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:08 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:08.931991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:08.933195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:08.940343 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:08.940795 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:08.941600 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:08.942041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:09.074996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:09.084112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:09.085652 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:09.086826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-776176d5-507c-48d8-b750-b2ad3119c366 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.159631 Jul 28 06:32:09.087797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 256/512] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:08 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:09.380279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:09.381056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:09.391009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:09.391637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:09.392449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:09.392891 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:09.528209 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:09.536105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-06d04d6b-6c59-43e6-964f-1f2800184bd0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.159915 Jul 28 06:32:09.538794 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 257/513] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:09 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:10.110332 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:10.110944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:10.117588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:10.118039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:10.118805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:10.119238 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:10.254801 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:10.264020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:10.265525 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:10.266661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-febd6588-3957-49b4-ab54-95625618d4af tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.160173 Jul 28 06:32:10.267220 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 257/514] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:10 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:10.559470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:10.560188 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:10.567334 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:10.568087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:10.568734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:10.569175 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:10.717485 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:10.725455 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-395409d8-2baa-43f6-b83f-5382c78b7b8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.170398 Jul 28 06:32:10.726037 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 258/515] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:10 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:11.289643 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:11.290255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:11.297449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:11.297900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:11.298661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:11.299103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:11.433210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:11.441512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:11.443010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:11.444152 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-96e75683-5d47-4d9b-837e-f3160088c949 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.158405 Jul 28 06:32:11.444696 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 258/516] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:11 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:32:11.748482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:11.748482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:11.754497 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:11.754951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:11.755728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:11.756172 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:11.889870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:11.897324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e7164c83-75e4-4a7f-8ee9-c885dbed34a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.154178 Jul 28 06:32:11.897897 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 259/517] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:11 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:12.468204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:12.468787 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:12.475537 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:12.475991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:12.476746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:12.477179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:12.613483 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:12.621810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:12.623298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:12.624562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-410a8f35-b4a5-40e9-8b50-bcac7df8d7de tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.160867 Jul 28 06:32:12.625122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 259/518] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:12 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:12.848239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:12.850591 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:12.857182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:12.857667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:12.858434 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:12.858872 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:12.881987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lazy-loading 'flavor' on Instance uuid 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:12.897550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:12.918946 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:12.919749 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:12.928548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:12.929172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:12.930096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:12.930652 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.062938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:13.071579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-53419e48-e377-426b-9999-980955b9e24d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.157154 Jul 28 06:32:13.086270 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 260/519] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:12 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:13.257045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e6bfe700-a560-437e-ba9b-bc703690e456 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/action" status: 200 len: 32 microversion: 2.1 time: 0.412756 Jul 28 06:32:13.257694 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 260/520] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:32:12 2022] POST /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/action => generated 32 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:32:13.268277 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:13.268825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:13.275039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:13.275543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.276980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:13.277436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.414004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:13.422652 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c3672d04-bf26-4a7c-a076-028a2ed7544f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.158441 Jul 28 06:32:13.423677 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 261/521] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:13 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:13.637940 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8fee8de-1084-4e61-902b-61bde25ca00c", "device": "/dev/sdb"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:13.640899 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:13.649148 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:13.650050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:13.650735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:13.651219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.655138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:13.655957 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.658555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:13.659134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.660053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:13.660587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:13.663722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:14.176045 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:14.185983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:14.187796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:14.188969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9ff85a62-a05d-482b-88a3-b2c0537f5dd0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.543900 Jul 28 06:32:14.189564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 262/522] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:13 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:14.194247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1459810299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-251647084", "security_groups": [{"name": "tempest-secgroup-smoke-546945479"}], "block_device_mapping_v2": [{"uuid": "0128e684-30ad-413e-ac1a-0011a62b0b26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd87854f-57d2-4562-b1ab-837a717d2f52"}]}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:14.524259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] validate_networks() for [('dd87854f-57d2-4562-b1ab-837a717d2f52', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:32:14.825138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-18122657-b07d-4ef6-89cd-6a6f67576de1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "POST /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.192274 Jul 28 06:32:14.833329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 261/523] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:32:13 2022] POST /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e/os-volume_attachments => generated 194 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:14.850992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:14.851716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:14.862659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:14.863318 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:14.865599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:14.866242 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:15.332563 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:15.341412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ccdb71ef-5507-47fc-a3df-5f582c10e3a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1682 microversion: 2.1 time: 0.513690 Jul 28 06:32:15.342309 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 262/524] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:14 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1682 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:15.359303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:15.360019 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:15.374120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:15.374120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:15.374120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:15.381122 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.091076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:32:16.092128 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:32:16.093219 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:32:16.093731 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:32:16.094348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:32:16.103205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:16.112089 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.112549 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.113377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.113816 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.115842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d4ee1ea4-d1ff-4150-a25b-f514fa4e5ec1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.772105 Jul 28 06:32:16.130256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 263/525] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:15 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:16.138439 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:16.139461 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:16.149496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.158365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.158521 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for project 47b406d9a12c461a84aa0331d2890990. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:32:16.158626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.158626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.165278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for user b1868c7d0ec8443b9ccb698ee02928b6 and project 47b406d9a12c461a84aa0331d2890990. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:32:16.256635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:32:16.258767 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0128e684-30ad-413e-ac1a-0011a62b0b26',volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:32:16.549602 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:16.561016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:16.563785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:16.565929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-879dbb9c-a78e-4bab-86f9-a537d7aed586 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.434384 Jul 28 06:32:16.578144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 264/526] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:16 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:16.589140 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:16.590855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:16.596882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.597695 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.598729 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.599394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.720766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:16.728575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-79745956-2196-4103-9a6f-915fd9dacb12 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 200 len: 1614 microversion: 2.1 time: 0.148936 Jul 28 06:32:16.746185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 265/527] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:16 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 1614 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:16.752428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-821c6b84-dba8-413c-bd8e-ee4770011b36 req-a91b7985-da6d-4549-9322-76ba85973afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3658bb5-2010-4828-b904-d276f960e32b", "name": "network-vif-deleted", "tag": "5446b4de-3891-4dc5-914c-530482a1e17e"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:16.765443 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-821c6b84-dba8-413c-bd8e-ee4770011b36 req-a91b7985-da6d-4549-9322-76ba85973afd service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:16.766182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-821c6b84-dba8-413c-bd8e-ee4770011b36 req-a91b7985-da6d-4549-9322-76ba85973afd service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:16.780503 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-821c6b84-dba8-413c-bd8e-ee4770011b36 req-a91b7985-da6d-4549-9322-76ba85973afd service nova] Creating event network-vif-deleted:5446b4de-3891-4dc5-914c-530482a1e17e for instance f3658bb5-2010-4828-b904-d276f960e32b on hv-cinder-81242 Jul 28 06:32:16.787466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-821c6b84-dba8-413c-bd8e-ee4770011b36 req-a91b7985-da6d-4549-9322-76ba85973afd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039508 Jul 28 06:32:16.788276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 266/528] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:16.833693 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-90088b85-5f15-4fdf-98f3-016614aff9a6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.639196 Jul 28 06:32:16.836179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 263/529] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:32:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:32:16.850147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c6f6beae-3cd6-413d-8c0a-b82b726d84b5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:16.851904 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c6f6beae-3cd6-413d-8c0a-b82b726d84b5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:17.006954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c6f6beae-3cd6-413d-8c0a-b82b726d84b5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:17.018833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c6f6beae-3cd6-413d-8c0a-b82b726d84b5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1094 microversion: 2.1 time: 0.172924 Jul 28 06:32:17.018928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 267/530] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:16 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1094 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:17.145419 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:17.147025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:17.155552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:17.156457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:17.157854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:17.158608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:17.354755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:17.364332 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-77044e14-c584-46b8-baf5-65d2ee66c3eb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.224254 Jul 28 06:32:17.381073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 264/531] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:17 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:17.594453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:17.594453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:17.596904 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=50 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:17.601379 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:17.602155 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:17.603210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:17.604281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:17.754511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:17.761746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:17.772979 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:17.773776 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:17.777668 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:17.782304 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:17.787620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:17.789139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:17.790378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-440db1fd-8f1e-4d8c-997a-a29f9bc62093 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.203367 Jul 28 06:32:17.791071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:17.809507 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 268/532] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:17 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:17.823377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b HTTP/1.1 Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:32:17.825051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:32:17.826519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'f3658bb5-2010-4828-b904-d276f960e32b'} Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:32:17.827250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:32:17.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:17.831028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:32:17.831894 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3978ceb1-34bb-417d-82e3-d2ba295e29b4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 404 len: 111 microversion: 2.1 time: 0.082016 Jul 28 06:32:17.841364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d255ef48-cc09-4262-be6b-d96ef7f424f1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '.version_select at 0x7fbe61cbbf70>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:17.846164 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 265/533] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:17 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:32:17.957584 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d255ef48-cc09-4262-be6b-d96ef7f424f1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327455864" status: 202 len: 0 microversion: 2.1 time: 0.120193 Jul 28 06:32:17.958261 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 269/534] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Jul 28 06:32:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327455864 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:32:18.039644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cfd3c1f1-7375-4ffa-9e80-17766def43c9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:18.040262 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cfd3c1f1-7375-4ffa-9e80-17766def43c9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:18.117531 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cfd3c1f1-7375-4ffa-9e80-17766def43c9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:18.132427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cfd3c1f1-7375-4ffa-9e80-17766def43c9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1094 microversion: 2.1 time: 0.096719 Jul 28 06:32:18.133502 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 266/535] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:18 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:18.377030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-92f652b0-07fe-4d3c-8d87-572bedf577a1 req-e5955659-2770-44d2-adfb-8870cb8ae2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "name": "network-vif-plugged", "status": "completed", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:18.389146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:18.390356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-92f652b0-07fe-4d3c-8d87-572bedf577a1 req-e5955659-2770-44d2-adfb-8870cb8ae2d8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.391637 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:18.391764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-92f652b0-07fe-4d3c-8d87-572bedf577a1 req-e5955659-2770-44d2-adfb-8870cb8ae2d8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.405019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.405681 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-92f652b0-07fe-4d3c-8d87-572bedf577a1 req-e5955659-2770-44d2-adfb-8870cb8ae2d8 service nova] Creating event network-vif-plugged:0d2efce0-28f9-47ea-a49a-15a80e72550a for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e on hv-cinder-81242 Jul 28 06:32:18.409711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.411336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-92f652b0-07fe-4d3c-8d87-572bedf577a1 req-e5955659-2770-44d2-adfb-8870cb8ae2d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037929 Jul 28 06:32:18.414951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 270/536] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:18.417807 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.419350 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.602707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:18.611077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-41afaa40-79bc-4c44-9b9c-2514b9ce25f0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.226864 Jul 28 06:32:18.625436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 267/537] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:18 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:18.825943 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:18.827350 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:18.833855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.834644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.835429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.836066 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.913175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:18.913721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:18.920247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.920695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.921504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:18.921972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:18.982899 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:18.991872 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:18.993417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:18.995133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-56993389-b369-41a1-9d2c-7edcdfa75f9a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.174389 Jul 28 06:32:19.000364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 271/538] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:18 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:19.066175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lazy-loading 'services' on Instance uuid b394488f-cd75-46c4-b399-909d7bd808fa {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:19.154282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:19.154911 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:19.161121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:19.161726 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:19.162527 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:19.163110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:19.233006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:19.240565 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ed3f9413-1b57-4c1b-b45a-854189a415f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1136 microversion: 2.1 time: 0.090931 Jul 28 06:32:19.241141 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 272/539] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:19 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:19.401596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-795b8abf-a718-4227-ab82-be39949e6de4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments/a71c0625-896f-4a13-8732-a9aa49946052" status: 202 len: 0 microversion: 2.1 time: 0.492175 Jul 28 06:32:19.402210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 268/540] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:32:18 2022] DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments/a71c0625-896f-4a13-8732-a9aa49946052 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:32:19.410463 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:19.412649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:19.419520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:19.419965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:19.420723 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:19.421151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:19.452899 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c168f58a-eef4-4d42-92c5-86df1e7449a3 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Jul 28 06:32:19.462557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 273/541] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:32:19 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:19.632479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:19.633186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:19.640072 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:19.640524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:19.641344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:19.641788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:19.772923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:19.781027 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-880f8c45-49c2-481d-82f7-ecc9ec8f10fb tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.152746 Jul 28 06:32:19.781636 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 269/542] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:19 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:20.019796 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:20.020466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:20.027116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.027572 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.028344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.028787 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.162662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:20.171311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:20.172827 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:20.174021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a91f0a53-30f7-4054-bea6-2abf54c3cf2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.158555 Jul 28 06:32:20.174629 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 274/543] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:20 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:20.264389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:20.265010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:20.271545 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.271998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.272758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.273195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.349389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:20.356914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9425d151-b55b-46b9-8cb9-be9070b793b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1192 microversion: 2.1 time: 0.096940 Jul 28 06:32:20.357512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 270/544] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:20 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:20.465811 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:20.467981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:20.473987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.474432 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.479040 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.479040 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.508800 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8001bca9-564e-48f1-bb9e-98bd949224a1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Jul 28 06:32:20.509735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 275/545] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:32:20 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:20.802151 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:20.802766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:20.808878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.809380 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.810155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:20.810592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:20.942837 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:20.950856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d4ae9f34-e6ab-4aa6-adc9-87dc1672ba73 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.152637 Jul 28 06:32:20.951420 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 271/546] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:20 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:21.196641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:21.197198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:21.203862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.204308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.205098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.205563 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.338562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:21.351114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:21.351114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:21.351114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4b6e9388-1271-4131-b781-04b08c161300 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.157691 Jul 28 06:32:21.351671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 276/547] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:21 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:21.378743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:21.379358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:21.386520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.386964 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.387749 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.388183 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.453519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:21.460873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0bf5b0eb-cbd2-487f-9fbd-b914673c5cd0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1210 microversion: 2.1 time: 0.086071 Jul 28 06:32:21.461812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 272/548] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:21 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:21.521011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:21.523280 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:21.530293 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.530749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.532081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.532081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.561329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:21.565990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ef104340-fa83-4210-a04b-c4b092948b79 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048940 Jul 28 06:32:21.566575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 277/549] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:32:21 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:21.973744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:21.974417 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:21.982050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.985156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:21.985156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:21.985156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.214823 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:22.223308 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d85c7910-984f-4398-856b-02edfa8b2f43 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.254533 Jul 28 06:32:22.223955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 273/550] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:21 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:22.378408 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:22.379167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:22.392655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:22.392655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.393675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:22.394502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.484154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:22.484716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:22.491116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:22.495980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.495980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:22.495980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.699825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:22.723073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:22.724658 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:22.726649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0f897517-0f70-4357-8db5-3173bec90cc2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1809 microversion: 2.20 time: 0.354403 Jul 28 06:32:22.741863 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 278/551] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:22 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1809 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:32:22.747732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:22.750212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:22.758052 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:22.758503 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.759526 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:22.760619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:22.790483 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5dc79e51-42fb-4170-ad3a-c43fea7f7102 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Jul 28 06:32:22.791079 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 279/552] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:32:22 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:22.810591 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:22.818441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3daaf0fd-30d6-439b-89ea-1798df7e8f82 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1277 microversion: 2.1 time: 0.338164 Jul 28 06:32:22.819013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 274/553] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:22 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1277 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:23.246462 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:23.247082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:23.254124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.254578 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.255539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.255975 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.449244 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-be7e3ce3-eebe-47b2-a75e-edca0560b6e3 req-3223822b-0e43-47a9-8ba2-66801ab2faf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8c072e-b6c3-486f-9755-c32b99e783f7", "tag": "e32626bb-30e6-43a9-9be6-672349e56fb4"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:23.462607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-be7e3ce3-eebe-47b2-a75e-edca0560b6e3 req-3223822b-0e43-47a9-8ba2-66801ab2faf9 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.463422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-be7e3ce3-eebe-47b2-a75e-edca0560b6e3 req-3223822b-0e43-47a9-8ba2-66801ab2faf9 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.476872 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:23.481883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-be7e3ce3-eebe-47b2-a75e-edca0560b6e3 req-3223822b-0e43-47a9-8ba2-66801ab2faf9 service nova] Creating event network-changed:e32626bb-30e6-43a9-9be6-672349e56fb4 for instance da8c072e-b6c3-486f-9755-c32b99e783f7 on hv-cinder-81242 Jul 28 06:32:23.487449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5631aeb2-c5b9-4fcd-9429-417d3ea22150 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.244689 Jul 28 06:32:23.488182 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-be7e3ce3-eebe-47b2-a75e-edca0560b6e3 req-3223822b-0e43-47a9-8ba2-66801ab2faf9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042791 Jul 28 06:32:23.489167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 275/554] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:32:23.490342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 280/555] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:23 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:23.753223 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:23.753999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:23.761690 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.762157 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.763020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.763461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.803865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:23.806207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:23.815117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.817833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.817833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.817833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.856302 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2b89cef8-726d-4496-bb02-37e5353974a4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056254 Jul 28 06:32:23.857112 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 281/556] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:32:23 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:23.864462 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:23.865190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:23.871892 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.872441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:23.873547 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:23.874206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:24.022330 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:24.046306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:24.048233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:24.050181 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ffea9963-bb4b-4432-96f7-25f264d689b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1796 microversion: 2.20 time: 0.301488 Jul 28 06:32:24.060247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 276/557] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:32:23 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1796 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:32:24.157494 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:24.165136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf6cb279-ee36-4d9a-b45e-7cba8459f13f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1277 microversion: 2.1 time: 0.306820 Jul 28 06:32:24.165751 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 282/558] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:23 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:24.512536 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:24.513147 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:24.519392 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:24.519838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:24.520597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:24.521030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:24.660796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:24.669557 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-570d06c9-fa87-479e-9a96-fd0632f4a0d7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.161336 Jul 28 06:32:24.670055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 277/559] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:24 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:24.868576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:24.871244 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:24.877732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:24.878177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:24.878936 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:24.879371 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:24.909111 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f6c31267-d6d7-49ab-baa8-4ccc9ec658d2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044461 Jul 28 06:32:24.909691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 283/560] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:32:24 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:32:24.973953 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:24.974441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:24.981170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:24.981644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:24.982393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:24.982821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.008368 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:32:25.187986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:25.188519 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:25.194640 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:25.195094 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.195856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:25.196291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.284413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d7ddd0f1-a43a-46d3-adf2-ba9c2e4fdd41 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 204 len: 0 microversion: 2.1 time: 0.313895 Jul 28 06:32:25.285200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 278/561] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:32:24 2022] DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:32:25.294299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:25.294972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:25.301019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:25.301523 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.302290 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:25.302717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.319214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:25.338930 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:25.346968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3b83291b-022f-4c4e-9c72-692eff347b33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1277 microversion: 2.1 time: 0.163016 Jul 28 06:32:25.357911 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 284/562] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:25 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:25.444838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:25.452375 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b2ad1da6-d502-4eab-9625-3874ebf19f17 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.162768 Jul 28 06:32:25.452957 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 279/563] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:25 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:25.691624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:25.692281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:25.699335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:25.699781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.700585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:25.701028 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:25.840127 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:25.848161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-06b18daf-c036-4a0c-bef9-5460ef90eb6a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.160384 Jul 28 06:32:25.848734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 285/564] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:25 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:26.368828 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:26.370049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:26.372921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:26.373767 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:26.378914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:26.379385 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:26.380163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:26.380600 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:26.474054 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:26.474680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:26.481814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:26.482267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:26.483049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:26.483490 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:26.517959 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:26.526250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b59a9640-41d8-47c1-87ff-c4c720917cec tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1277 microversion: 2.1 time: 0.160378 Jul 28 06:32:26.526895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 280/565] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:26 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:26.624036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:26.631488 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4a5a1cc1-d8a7-481e-a380-906cd5428a06 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.161233 Jul 28 06:32:26.632053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 286/566] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:26 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:26.870686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:26.871202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:26.877681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:26.878145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:26.878913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:26.879342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:27.007781 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:27.016422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-62538abf-3713-46bd-9bc9-eb93d3cddae9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.150668 Jul 28 06:32:27.016987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 281/567] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:26 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:27.546935 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:27.547520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:27.549430 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:27.554771 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:27.555212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:27.556001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:27.556429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:27.653422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:27.654038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:27.660588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:27.661040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:27.661829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:27.662268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:27.690115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:27.697825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-01dbc04a-932e-4a2f-8970-6bb7579359be tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1277 microversion: 2.1 time: 0.154756 Jul 28 06:32:27.698521 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 287/568] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:27 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:27.797931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:27.805686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-74fd8977-eb3b-4ec0-87e1-7149a1905751 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.156213 Jul 28 06:32:27.806271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 282/569] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:27 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:28.038993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:28.039603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:28.045780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:28.046230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:28.046990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:28.047427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:28.175630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:28.184284 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-52aa2a39-8e91-4579-9c90-26b9eb50f976 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.149167 Jul 28 06:32:28.184858 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 288/570] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:28 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:28.722142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:28.723232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:28.726410 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=8 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:28.733781 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:28.734467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:28.735485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:28.736116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:28.829186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:28.830823 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:28.838644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:28.839164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:28.840030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:28.840630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:28.897729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:28.905531 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-53899c15-256b-4288-9f71-49fc246d44a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1277 microversion: 2.1 time: 0.190049 Jul 28 06:32:28.906116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 283/571] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:28 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:28.983786 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:28.991294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0e8c3df5-77a2-4888-a280-1e2287e0fc74 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.166293 Jul 28 06:32:28.991871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 289/572] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:28 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:29.205152 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:29.205716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:29.211758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:29.212466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:29.213287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:29.213747 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:29.347123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:29.356246 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8da90e10-2927-4da0-91bc-f19dc7533e4a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.155093 Jul 28 06:32:29.356860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 284/573] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:29 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:29.927393 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:29.928003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:29.934881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:29.935326 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:29.936088 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:29.936516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:30.013147 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:30.013800 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:30.020490 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:30.020943 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:30.021743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:30.022185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:30.081360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:30.089124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-17283a8f-fe2e-4501-aea9-ff9349d3bdff tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.165601 Jul 28 06:32:30.089722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 290/574] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:29 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:30.167175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:30.174660 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-569c1e96-4b02-4ca2-9005-4a3db04f0471 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.166490 Jul 28 06:32:30.175234 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 285/575] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:30 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:30.389013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:30.389659 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:30.395781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:30.396224 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:30.396995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:30.397456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:30.543146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:30.551104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2aded3f4-55e6-4e86-b527-bdb7ce3f0e60 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.166922 Jul 28 06:32:30.551670 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 291/576] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:30 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:31.110529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:31.111056 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:31.117759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:31.118258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:31.119568 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:31.120170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:31.196608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:31.197984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:31.204104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:31.204555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:31.205346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:31.205785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:31.262778 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:31.270323 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-26ac68a4-5691-4922-98c6-92b04dd819b9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.163713 Jul 28 06:32:31.270904 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 286/577] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:31 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:31.349338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:31.358063 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cb491260-433d-4bd1-8a1f-a87ad9204b61 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.165281 Jul 28 06:32:31.358624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 292/578] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:31 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:31.574065 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:31.574713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:31.580793 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:31.581246 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:31.582047 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:31.582485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:31.710135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:31.718315 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a2121775-7424-4b27-aff5-c7c64ebf0eb0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.148851 Jul 28 06:32:31.718914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 287/579] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:31 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:32.224731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:32.225268 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:32.232457 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.232905 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.233797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.234236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.292201 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:32.292900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:32.298927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.299335 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.300107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.300546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.369605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lazy-loading 'services' on Instance uuid c9b09806-4463-4247-ba82-c87e3362cbd4 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:32.522383 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:32.587479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a9e44566-e5a2-4f1a-94ef-84176a9f0c60 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-volume_attachments/39496db6-a25f-4aa9-8389-4fccce4c981d" status: 202 len: 0 microversion: 2.1 time: 0.366260 Jul 28 06:32:32.591738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 293/580] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:32:32 2022] DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-volume_attachments/39496db6-a25f-4aa9-8389-4fccce4c981d => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:32:32.594210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:32.594942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:32.601820 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.602907 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.604358 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.604981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.848615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:32.856960 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b9eff48f-3878-4f7a-81b4-d8ad4297f184 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.569672 Jul 28 06:32:32.857672 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 288/581] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:32 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:32.878138 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:32.878762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:32.884866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.885331 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.886136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:32.886579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:32.926437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:32.935147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-769252cb-6a5e-4b09-b971-4887b32edb68 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1683 microversion: 2.1 time: 0.345117 Jul 28 06:32:32.945822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 294/582] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:32 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1683 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:33.121480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:33.129581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-32f4b7bb-1e54-4780-a0ed-4f880625755b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.255122 Jul 28 06:32:33.130160 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 289/583] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:32 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:33.782202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-bcbdd815-8e39-4240-b280-6f69c27f230b req-4ecd3204-ce8d-4e02-81d5-168b4418f520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b394488f-cd75-46c4-b399-909d7bd808fa", "name": "network-vif-deleted", "tag": "f73695a0-ec1f-4387-94ac-3d3ad1c57c48"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:33.793737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-bcbdd815-8e39-4240-b280-6f69c27f230b req-4ecd3204-ce8d-4e02-81d5-168b4418f520 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:33.794182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-bcbdd815-8e39-4240-b280-6f69c27f230b req-4ecd3204-ce8d-4e02-81d5-168b4418f520 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:33.807366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-bcbdd815-8e39-4240-b280-6f69c27f230b req-4ecd3204-ce8d-4e02-81d5-168b4418f520 service nova] Creating event network-vif-deleted:f73695a0-ec1f-4387-94ac-3d3ad1c57c48 for instance b394488f-cd75-46c4-b399-909d7bd808fa on hv-cinder-81242 Jul 28 06:32:33.812201 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-bcbdd815-8e39-4240-b280-6f69c27f230b req-4ecd3204-ce8d-4e02-81d5-168b4418f520 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034006 Jul 28 06:32:33.813212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 295/584] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:32:33.879035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:33.879714 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:33.905850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:33.906306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:33.907091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:33.907532 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:33.964629 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:33.966307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:33.986122 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:33.986988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:33.987368 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:33.987810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:34.070110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:34.078732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1e501d5b-4b41-4fdd-9590-1cfff723c136 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1327 microversion: 2.1 time: 0.126299 Jul 28 06:32:34.079335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 296/585] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:33 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:34.097855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:34.105558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-da1caf12-37c0-45e2-b078-a8dfb62c15f6 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.230499 Jul 28 06:32:34.106127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 290/586] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:33 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:34.152230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:34.152959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:34.158998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:34.159472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:34.160241 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:34.160733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:34.292245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:34.300589 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3f0b2aaa-5b78-475f-a433-0f5edc7d2b12 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.152268 Jul 28 06:32:34.301168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 297/587] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:34 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:34.786963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4b3ca2e2-27e0-4e37-94f4-c6608d3041e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:34.793876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4b3ca2e2-27e0-4e37-94f4-c6608d3041e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:34.794318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4b3ca2e2-27e0-4e37-94f4-c6608d3041e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:34.816212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4b3ca2e2-27e0-4e37-94f4-c6608d3041e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Going to try to stop instance {{(pid=118388) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 06:32:35.045209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4b3ca2e2-27e0-4e37-94f4-c6608d3041e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action" status: 202 len: 0 microversion: 2.1 time: 0.261861 Jul 28 06:32:35.045891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 291/588] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:32:34 2022] POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:32:35.053819 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:35.054451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:35.060981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.061469 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.062225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.063257 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.100558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:35.101259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:35.107994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.108442 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.109222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.109688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.187822 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:35.195387 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-eb96b183-d419-4c1b-aeb8-57ecf32fc60c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1327 microversion: 2.1 time: 0.099064 Jul 28 06:32:35.196177 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 292/589] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:35 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:35.201215 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:35.201858 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:35.209757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.209757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.209757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.209757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.221074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:35.229082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3c617734-1116-4715-99fe-985a58189d0d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.179051 Jul 28 06:32:35.229783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 298/590] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:35 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:35.323515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:35.324148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:35.330487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.331247 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.331822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:35.332146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:35.347214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:35.355688 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b6e7ca16-453b-4a73-a5f0-a55b36b675a3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.158691 Jul 28 06:32:35.356421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 293/591] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:35 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:35.472489 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:35.480500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-daabec39-8f32-4316-8f44-2f8abe3c9c63 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.161573 Jul 28 06:32:35.481059 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 299/592] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:35 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:36.217642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:36.218258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:36.224708 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.230117 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.230117 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.230117 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.250913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:36.252156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:36.258752 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.260334 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.260954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.261420 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.290114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:36.298592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b92dcee7-afbd-42ec-be5f-6fb72aa28049 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1327 microversion: 2.1 time: 0.084741 Jul 28 06:32:36.299540 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 294/593] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:36 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1327 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:36.376280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:36.376893 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:36.382934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.383391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.384159 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.384959 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.389454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:36.395015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:36.403925 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-59f80a62-94cb-4852-a91e-3c59d7e87122 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.156804 Jul 28 06:32:36.404500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 300/594] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:36 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:36.501682 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:36.502316 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:36.508783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.511973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.511973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:36.511973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:36.529659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:36.537020 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cfda446c-4f05-4003-b395-f0908765baeb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.164792 Jul 28 06:32:36.537633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 295/595] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:36 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:36.643177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:36.651739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5e97d861-8882-4198-846e-c7758bb28c1d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.153883 Jul 28 06:32:36.652381 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 301/596] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:36 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:37.320410 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:37.321032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:37.328396 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.328842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.329631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.330072 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.363106 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.363559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.364070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lazy-loading 'fault' on Instance uuid b394488f-cd75-46c4-b399-909d7bd808fa {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:37.406918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:37.414379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d08815f0-0235-4a06-bebd-c391ec476c07 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1332 microversion: 2.1 time: 0.098292 Jul 28 06:32:37.414934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 296/597] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:37 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:37.425911 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:37.426512 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:37.433008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.433493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.434280 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.434709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.558725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:37.559336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:37.565517 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.565968 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.566739 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.567174 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.579102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:37.584549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cfc11f25-29c2-4b07-911e-83705d5b7dac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.162587 Jul 28 06:32:37.585418 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 302/598] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:37 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:37.673428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:37.674038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:37.680791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.681235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.682598 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:37.682991 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:37.705682 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:37.713527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e15945cb-a1d7-4a02-92f4-7725c62fe5a0 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.159274 Jul 28 06:32:37.714171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 297/599] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:37 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:37.826472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:37.834814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-78a70402-2d85-4371-9ee3-799dc9b980c5 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.164818 Jul 28 06:32:37.835401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 303/600] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:37 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:38.436055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:38.436664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:38.443209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.443663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.444499 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.444991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.478572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.479160 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.479556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lazy-loading 'fault' on Instance uuid b394488f-cd75-46c4-b399-909d7bd808fa {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:38.520912 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:38.528556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1e97c1ff-67aa-4a94-bb2f-414358b34409 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 200 len: 1332 microversion: 2.1 time: 0.096939 Jul 28 06:32:38.529143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 298/601] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:38 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:38.605637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:38.606249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:38.612892 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.613404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.614207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.614642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.734764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:38.735381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:38.741230 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.741812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.742477 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.742944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.747121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:38.755929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-46a5b69c-179a-48ea-a164-4377a5fa80e6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.154215 Jul 28 06:32:38.756502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 304/602] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:38 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:38.856687 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:38.857338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:38.863612 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.864061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.865031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:38.865501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:38.886951 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:38.894361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-751d4746-61de-46e3-853b-d12cc27b10dc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.163407 Jul 28 06:32:38.894939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 299/603] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:38 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:39.003814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:39.011739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0f6cfc56-dc39-426d-803a-c811d83f38b9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.159621 Jul 28 06:32:39.012312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 305/604] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:38 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:39.549584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:39.550160 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:39.556494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:39.556944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:39.557747 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:39.558176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:39.571569 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa HTTP/1.1 Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:32:39.573754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:32:39.575342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'b394488f-cd75-46c4-b399-909d7bd808fa'} Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:32:39.576287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:32:39.577868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:32:39.579630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:32:39.579630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2adffdb2-3ed2-4def-ba50-359064a46369 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 404 len: 111 microversion: 2.1 time: 0.029557 Jul 28 06:32:39.579630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 300/605] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:39 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:32:39.584126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-813fad9d-c309-4525-a09d-b527fae5ab34 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '.version_select at 0x7fbe61c2cdc0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:39.665613 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-813fad9d-c309-4525-a09d-b527fae5ab34 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854749797" status: 202 len: 0 microversion: 2.1 time: 0.085189 Jul 28 06:32:39.666574 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 306/606] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Jul 28 06:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854749797 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:32:39.778299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:39.778905 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:39.784798 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:39.785240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:39.786032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:39.786461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:39.916399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:39.917029 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:39.924401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:39.924562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:39.925171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:39.925988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:39.926592 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:39.936450 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2a0a3257-4f63-4102-950b-34f7c807e221 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.162698 Jul 28 06:32:39.937438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 301/607] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:39 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:40.032290 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:40.033091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:40.039170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:40.039617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:40.040369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:40.040850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:40.247716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:40.255682 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-012fbc7e-b84f-4483-9ed3-bba8da1a8131 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.343457 Jul 28 06:32:40.256416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 307/608] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:39 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:40.300036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:40.308810 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dec2b76e-8edd-4eff-b595-fda00d09d6b0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1735 microversion: 2.1 time: 0.280337 Jul 28 06:32:40.309411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 302/609] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:40 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:40.662471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8cab04e-b46f-4ca7-aa74-28b36f466824 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: .version_select at 0x7fbe61bbc550>, body: {"keypair": {"name": "tempest-keypair-598234788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2mBW5ArsZ4qiuwWpYzJhOy6vgWPDX8tNdlQDwmKc5B+JNvCtNnaziERo+I4ljX+pj4eIC/pOaa+ySJGnIY4B1fxUr1TVft2rk8ZEsQi3QccxYfZO45hQ+UBfWUUylrvg=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:40.677728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-c8cab04e-b46f-4ca7-aa74-28b36f466824 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:32:40.682164 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-c8cab04e-b46f-4ca7-aa74-28b36f466824 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:32:40.797883 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8cab04e-b46f-4ca7-aa74-28b36f466824 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139706 Jul 28 06:32:40.798500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 308/610] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:32:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:40.959044 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:40.959702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:40.968163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:40.968620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:40.969432 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:40.969878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.154012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:41.154012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-06e5a3c4-d407-4a56-9d25-a02368086086 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.196300 Jul 28 06:32:41.154012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 303/611] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:40 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:41.176689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:41.177187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:41.183791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.184791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.185606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.186051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.275546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lazy-loading 'services' on Instance uuid b8486067-5ab6-483a-84c4-8d4eb4f1b07e {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:41.281770 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:41.282637 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:41.289113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.289822 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.290608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.291070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.435632 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:41.444254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f633c71b-f945-4d9f-97f8-056563658e54 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.168788 Jul 28 06:32:41.445114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 304/612] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:41 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:41.450789 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:41.453361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:41.457692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.458141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.458999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.459436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.506375 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-329c950a-0423-4602-9187-0e5c1648ac0d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e/os-volume_attachments/b8fee8de-1084-4e61-902b-61bde25ca00c" status: 202 len: 0 microversion: 2.1 time: 0.333558 Jul 28 06:32:41.506983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 309/613] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:32:41 2022] DELETE /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e/os-volume_attachments/b8fee8de-1084-4e61-902b-61bde25ca00c => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:32:41.605339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:41.613790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-05795ddb-8bd9-407b-8478-3c9bfbc75130 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1715 microversion: 2.1 time: 0.167451 Jul 28 06:32:41.614363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 305/614] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:41 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:41.732983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:41.733676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:41.740124 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.744256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.744256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.744256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.826300 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] HTTP exception thrown: Cannot 'detach_volume' instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 while it is in vm_state rescued Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Request method failure captured: Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments/fd931a90-8726-46c3-9227-dc2ba1ebf160 HTTP/1.1 Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyFZqivNqvdDUS-uLdFM5ziieab-PJrUIzmvCD-ZoZIRHY0SfXjhsvjF9tt_kdGSoem1WjbHFQ-9pMnCRFcH4pkOEMkMxgTJx-G-k-98K_Q3r2U03P_NI14JJAwV3mV-llB9l6nzFnP4Lt_fWfVVhcQZj7mS2MzIq-U6MwSpJLQW6I Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:32:41.827922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cd88554db98441c99e0b09b446c24b47", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}] Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 86a5553819d949ffbc64b7a388942baf Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:32:41.829496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Cannot 'detach_volume' instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 while it is in vm_state rescued Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'server_id': '028a5ad9-f35d-4c21-b9cb-8f9979d1e113', 'id': 'fd931a90-8726-46c3-9227-dc2ba1ebf160'} Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:32:41.830361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 while it is in vm_state rescued Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 while it is in vm_state rescued Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:41.831893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Returning 409 to user: Cannot 'detach_volume' instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 while it is in vm_state rescued {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:32:41.833083 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-484118bb-1ba2-463e-913b-2a06518dd4bf tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments/fd931a90-8726-46c3-9227-dc2ba1ebf160" status: 409 len: 152 microversion: 2.1 time: 0.102121 Jul 28 06:32:41.833253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 310/615] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:32:41 2022] DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments/fd931a90-8726-46c3-9227-dc2ba1ebf160 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 06:32:41.838529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:41.839091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:41.845424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.845882 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:41.846645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:41.847082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.097812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-380d8f91-6753-48a2-aa93-a4f5abaa17bd tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "POST /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/action" status: 202 len: 0 microversion: 2.1 time: 0.262869 Jul 28 06:32:42.099168 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 306/616] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:32:41 2022] POST /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:32:42.107707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:42.109195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:42.111208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:42.116358 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:42.116816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.117708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:42.118151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.174122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:42.175063 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:42.182458 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:42.183162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.184185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:42.184782 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.378630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:42.396248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f460bc18-bbc4-4b3f-8c02-81f05be3c1df tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1723 microversion: 2.1 time: 0.293088 Jul 28 06:32:42.399928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 311/617] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:42 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:42.419584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:42.427692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2156446b-baa5-452f-b62b-4206aa0d58e1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.258851 Jul 28 06:32:42.428911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 307/618] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:42 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:42.471050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:42.472024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:42.480179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:42.481173 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.482151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:42.482917 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:42.504579 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:42.755198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:42.769566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d5c457f6-88ea-416e-aa9b-a361fc39aaf8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.305001 Jul 28 06:32:42.786773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 312/619] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:42 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:43.420877 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:43.421537 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:43.428246 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:43.428780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:43.429584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:43.430049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:43.451527 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:43.452219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:43.458903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:43.459346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:43.460108 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:43.460537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:43.873006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:43.880155 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:43.881003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b3d95fef-96be-41f5-81c9-a418de8dc0c3 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1723 microversion: 2.1 time: 0.464671 Jul 28 06:32:43.881819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 308/620] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:43 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:43.888980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4a7fac68-e5ef-493a-a516-1e92d470b8b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.441807 Jul 28 06:32:43.901409 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 313/621] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:43 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:43.901585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1079712288", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbc8d74-4a13-4069-9d84-f85f9df7bdf6"}], "security_groups": [{"name": "tempest-securitygroup--993937807"}], "key_name": "tempest-keypair-598234788", "user_data": "}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:43.901713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:43.901713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:43.909462 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:43.910180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:43.911426 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:43.912149 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:43.954038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:32:44.026975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] validate_networks() for [('fbbc8d74-4a13-4069-9d84-f85f9df7bdf6', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:32:44.271708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ee82b1f0-6df6-4e6a-9211-616b615b317e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 204 len: 0 microversion: 2.1 time: 0.379087 Jul 28 06:32:44.271867 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 314/622] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:32:43 2022] DELETE /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:32:44.277375 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:44.278811 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:44.286261 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.286772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.287608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.288099 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.498283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:32:44.498761 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:32:44.499204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:32:44.499751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:32:44.500172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:32:44.503415 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:44.511485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.512039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.514350 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-46eae67a-ddb8-4aba-adb5-0b91ea25b52b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.239286 Jul 28 06:32:44.514597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.514693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 315/623] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:44 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:44.514777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.518386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:44.518981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:44.524873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.525355 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.526100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.526528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.536617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:32:44.541129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:32:44.554226 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:32:44.556612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:32:44.667138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:44.676175 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b5b9a86d-169e-4448-a5b6-399532785fd7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1512 microversion: 2.1 time: 0.161409 Jul 28 06:32:44.676776 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 316/624] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:44 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:44.681258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-6955bca2-0b7a-4bca-abf2-8bb95b18399b req-c2762c13-9cea-4914-ad53-f1b0c27126c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8c072e-b6c3-486f-9755-c32b99e783f7", "name": "network-vif-plugged", "status": "completed", "tag": "e32626bb-30e6-43a9-9be6-672349e56fb4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:44.691128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6955bca2-0b7a-4bca-abf2-8bb95b18399b req-c2762c13-9cea-4914-ad53-f1b0c27126c4 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.691569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6955bca2-0b7a-4bca-abf2-8bb95b18399b req-c2762c13-9cea-4914-ad53-f1b0c27126c4 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.704118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-6955bca2-0b7a-4bca-abf2-8bb95b18399b req-c2762c13-9cea-4914-ad53-f1b0c27126c4 service nova] Creating event network-vif-plugged:e32626bb-30e6-43a9-9be6-672349e56fb4 for instance da8c072e-b6c3-486f-9755-c32b99e783f7 on hv-cinder-81242 Jul 28 06:32:44.708881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-6955bca2-0b7a-4bca-abf2-8bb95b18399b req-c2762c13-9cea-4914-ad53-f1b0c27126c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030884 Jul 28 06:32:44.709500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 317/625] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:44.738295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5e178765-1844-4f59-ae38-0be026967974 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.849411 Jul 28 06:32:44.739015 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 309/626] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:32:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:32:44.752211 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1ca01cf1-59f4-4770-a468-eefb6a11f181 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:44.754218 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1ca01cf1-59f4-4770-a468-eefb6a11f181 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:44.807431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1ca01cf1-59f4-4770-a468-eefb6a11f181 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:44.815121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1ca01cf1-59f4-4770-a468-eefb6a11f181 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1241 microversion: 2.1 time: 0.068572 Jul 28 06:32:44.815789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 318/627] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:44 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:44.903195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:44.903799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:44.911224 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.911681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.912171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:44.912622 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.912871 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.913080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:44.922045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.922780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:44.923691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:44.924135 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.119855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:45.123459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:45.129799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9061677a-336e-4ef3-beb2-a9b7b850cd2c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1723 microversion: 2.1 time: 0.230412 Jul 28 06:32:45.130644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 310/628] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:44 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:45.131448 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-44a93eb6-f8ef-4f43-bda4-c87325a08f39 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.223576 Jul 28 06:32:45.132021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 319/629] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:44 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:45.535859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:45.536790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:45.543541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:45.543995 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.544785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:45.545251 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.560299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:45.682329 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:45.689836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5f61ead-8077-4fe3-add6-f3d0a749b6fb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.158225 Jul 28 06:32:45.690409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 311/630] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:45 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:45.698386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:45.699082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:45.707208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:45.707656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.708577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:45.708864 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.840150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:45.842487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:45.843173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:45.847950 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7e9d93f1-1a9f-4f0d-bc11-f4f2ecc4baf4 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1512 microversion: 2.1 time: 0.153636 Jul 28 06:32:45.848540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 320/631] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:45 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:45.849893 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:45.850346 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.851114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:45.851548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:45.911717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:45.919297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e73f09a7-b654-4de9-9e18-e935a11e2849 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1245 microversion: 2.1 time: 0.081124 Jul 28 06:32:45.919867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 312/632] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:45 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:46.152331 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:46.153649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:46.153790 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:46.154265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:46.159977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.160266 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.160431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.160713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.161210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.161503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.161691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.161936 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.371144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:46.375074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:46.379867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b28d861e-b07b-42f6-9ab4-bed85ff5d65d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1676 microversion: 2.1 time: 0.230837 Jul 28 06:32:46.380507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 313/633] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:46 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:46.383479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2ee39e46-7862-45f2-b3aa-e16059519881 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1723 microversion: 2.1 time: 0.235222 Jul 28 06:32:46.386194 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 321/634] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:46 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:46.710430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:46.711267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:46.718643 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.719085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.719843 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.720272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.869247 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:46.869967 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:46.877096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.877656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:46.878520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:46.879175 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.104079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:47.112430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1d9ff6b7-ac0a-4664-8d1a-62cf84742759 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.405776 Jul 28 06:32:47.113175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 314/635] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:46 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:47.131035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:47.131658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:47.138699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.139149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.139918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.140359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.199885 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:47.212006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-63694095-fc4f-4a5b-a4aa-b9b1562dd8d6 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1512 microversion: 2.1 time: 0.346161 Jul 28 06:32:47.213324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 322/636] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:46 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:47.227113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:47.244717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-69868533-3009-4985-8861-6fc2c5f0f5a9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1293 microversion: 2.1 time: 0.117159 Jul 28 06:32:47.247914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 315/637] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:47 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1293 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:47.401631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:47.402259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:47.407899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:47.408512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:47.409110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.409605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.410430 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.410869 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.414705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.415354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.416143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.416716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.688527 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:47.696151 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1a95f677-a471-4b9a-ad2e-98600e0e5b33 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1653 microversion: 2.1 time: 0.298690 Jul 28 06:32:47.702177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 323/638] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:47 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1653 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:47.702461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:47.702588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-c90903b5-f9db-4000-b62b-60d0229357cd req-0d497d02-bfd0-41c4-a95b-e42d3bf4fdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8486067-5ab6-483a-84c4-8d4eb4f1b07e", "name": "network-vif-deleted", "tag": "f10204df-a4f7-4635-be5a-4e54d32ca919"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:47.708890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-25dc58cd-aa96-4383-9a74-a877989aa7c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1729 microversion: 2.1 time: 0.304887 Jul 28 06:32:47.709722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 316/639] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:47 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:47.716588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c30070a1-e59d-4a5d-b9b2-d5581974779b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:47.719501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-c90903b5-f9db-4000-b62b-60d0229357cd req-0d497d02-bfd0-41c4-a95b-e42d3bf4fdf7 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.720225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-c90903b5-f9db-4000-b62b-60d0229357cd req-0d497d02-bfd0-41c4-a95b-e42d3bf4fdf7 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.733515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-c90903b5-f9db-4000-b62b-60d0229357cd req-0d497d02-bfd0-41c4-a95b-e42d3bf4fdf7 service nova] Creating event network-vif-deleted:f10204df-a4f7-4635-be5a-4e54d32ca919 for instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e on hv-cinder-81242 Jul 28 06:32:47.738522 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-c90903b5-f9db-4000-b62b-60d0229357cd req-0d497d02-bfd0-41c4-a95b-e42d3bf4fdf7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040347 Jul 28 06:32:47.739120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 324/640] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:47.742099 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c30070a1-e59d-4a5d-b9b2-d5581974779b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.742433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c30070a1-e59d-4a5d-b9b2-d5581974779b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.745422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:47.746003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:47.752860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.753331 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.754143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.754580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.767578 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c30070a1-e59d-4a5d-b9b2-d5581974779b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Going to try to start instance {{(pid=118388) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 06:32:47.842312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8cd71263-b755-4759-b2f4-d57333c2c8d6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101237 Jul 28 06:32:47.842941 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 325/641] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:32:47 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:47.947853 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c30070a1-e59d-4a5d-b9b2-d5581974779b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action" status: 202 len: 0 microversion: 2.1 time: 0.234869 Jul 28 06:32:47.948476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 317/642] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:32:47 2022] POST /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:32:47.957608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:47.958325 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:47.965069 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.965664 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:47.967862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:47.967862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.139637 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:48.140429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:48.146777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:48.147707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.148348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:48.148853 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.253871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:48.261497 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2f1b28a-72da-4c54-90fa-a958cb09c878 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1662 microversion: 2.1 time: 0.308102 Jul 28 06:32:48.262074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 326/643] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:47 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1662 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:48.270879 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:48.271642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:48.279975 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:48.280587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.281555 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:48.282251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.404303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:48.406954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-96e452d5-aee2-437c-ba84-9973e4a15b97 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1303 microversion: 2.1 time: 0.143679 Jul 28 06:32:48.407785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 327/644] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:48 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:48.412409 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:48.413216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:48.419566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:48.420016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.423422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:48.423422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:48.479255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:48.487421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3b314790-4571-41fe-a1d5-7c0627c02992 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1265 microversion: 2.1 time: 0.352550 Jul 28 06:32:48.488097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 318/645] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:48 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:48.501248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:48.509021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c94147af-1fed-461c-a5c7-d5411fbd69b5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1301 microversion: 2.1 time: 0.100252 Jul 28 06:32:48.509623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 328/646] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:48 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:49.287417 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:49.288012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:49.295075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.295774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.296529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.296963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.431722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:49.433122 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:49.440342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.440789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.441587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.442170 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.476128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.476584 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.477034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lazy-loading 'fault' on Instance uuid b8486067-5ab6-483a-84c4-8d4eb4f1b07e {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:32:49.615106 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:49.617937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:49.625960 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4b6e0345-f180-44aa-87d7-f8d62bac7f7f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 200 len: 1308 microversion: 2.1 time: 0.198658 Jul 28 06:32:49.631313 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 329/647] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:49 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:49.633990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:49.634668 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:49.642559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.643114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.643976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.644345 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.768581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:49.776982 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ee45f6b6-76d2-4b4d-914b-f1bd4340cb12 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1662 microversion: 2.1 time: 0.493740 Jul 28 06:32:49.778874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 319/648] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:49 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1662 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:49.783770 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:49.784642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:49.787198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:49.792298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.793124 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.798373 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:49.798373 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:49.973612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:49.982301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4472502a-c324-4e64-a75f-4968b2a56f5c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1299 microversion: 2.1 time: 0.201899 Jul 28 06:32:49.982772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 320/649] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:49 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:50.076660 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:50.084580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4311e200-174e-4459-8bcc-025bc017f45c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1453 microversion: 2.1 time: 0.456284 Jul 28 06:32:50.092593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 330/650] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:49 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1453 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:50.109161 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:50.109838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:50.116389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.116905 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:50.117711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.118153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:50.179571 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-e022e562-89fc-414c-acb3-ab7b3b6c035f req-94aa2350-f538-4f58-b876-76145b60827c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:50.192798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e022e562-89fc-414c-acb3-ab7b3b6c035f req-94aa2350-f538-4f58-b876-76145b60827c service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.193535 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-e022e562-89fc-414c-acb3-ab7b3b6c035f req-94aa2350-f538-4f58-b876-76145b60827c service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:50.208987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-e022e562-89fc-414c-acb3-ab7b3b6c035f req-94aa2350-f538-4f58-b876-76145b60827c service nova] Creating event network-changed:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:32:50.214675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-e022e562-89fc-414c-acb3-ab7b3b6c035f req-94aa2350-f538-4f58-b876-76145b60827c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040318 Jul 28 06:32:50.216412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 331/651] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:50.534574 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:50.544541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1914f671-4ce0-43f8-aa9e-8c0edb6a5d2c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1453 microversion: 2.1 time: 0.440421 Jul 28 06:32:50.545048 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 321/652] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:50 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1453 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:50.648891 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:50.649624 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: b8486067-5ab6-483a-84c4-8d4eb4f1b07e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:50.661353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.662220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:50.663212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.663996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:50.687806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] HTTP exception thrown: Instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e could not be found. Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Request method failure captured: Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e HTTP/1.1 Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i0lgsE0fjB9q9QSJ2AiQFPK1iugXoau0E1Jkd7hK6dUfHCsb-L-Ph56GTifpJLGSjiPLViNJQoHoxcX03i6CvHddAt6mdnkbF33Tu8M80YBg0ovrWUldVJWFlFDkUEwhC9n9KIktN6c8ptvnFUhKAruy-ceiqju1Ntvyuj7fY9G7iE Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: f33d1845b3b643b99b066eaeee429e12 Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotTestJSON-731057165 Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:32:50.693807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f33d1845b3b643b99b066eaeee429e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f33d1845b3b643b99b066eaeee429e12", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f33d1845b3b643b99b066eaeee429e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f33d1845b3b643b99b066eaeee429e12"}]}] Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotTestJSON-731057165 Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: f33d1845b3b643b99b066eaeee429e12 Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-731057165 Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotTestJSON-731057165-project Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 97547d56a8684009a794a42ad1c5f489 Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotTestJSON-731057165-project Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e could not be found. Jul 28 06:32:50.695259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b8486067-5ab6-483a-84c4-8d4eb4f1b07e'} Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e could not be found. Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:32:50.696119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e could not be found. Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e could not be found. Jul 28 06:32:50.698853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:32:50.703198 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Returning 404 to user: Instance b8486067-5ab6-483a-84c4-8d4eb4f1b07e could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:32:50.704306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58dcfac7-e563-42c3-8835-37664359f60f tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e" status: 404 len: 111 microversion: 2.1 time: 0.060045 Jul 28 06:32:50.706344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 332/653] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:50 2022] GET /compute/v2.1/servers/b8486067-5ab6-483a-84c4-8d4eb4f1b07e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:32:50.801363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:50.802073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:50.814790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.817005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:50.820184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:50.820631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:51.006249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:51.007287 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:51.018903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:51.025656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:51.025656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:51.032036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:51.211921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:51.229474 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e650521a-0858-45d4-a740-6fc5c0518af4 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1662 microversion: 2.1 time: 0.433658 Jul 28 06:32:51.230660 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 322/654] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:50 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1662 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:51.763098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:51.770658 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0d7ab24b-a455-4528-9807-ff77604fcad0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.770088 Jul 28 06:32:51.774698 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 333/655] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:50 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:32:52.241801 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-94ec3d38-4ecb-4eb9-a976-ff48d74adb13 req-2454f68c-bf68-4af4-8105-ad0e0c233263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:52.251226 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:52.251668 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-94ec3d38-4ecb-4eb9-a976-ff48d74adb13 req-2454f68c-bf68-4af4-8105-ad0e0c233263 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:52.252238 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-94ec3d38-4ecb-4eb9-a976-ff48d74adb13 req-2454f68c-bf68-4af4-8105-ad0e0c233263 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:52.253758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:52.265457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-94ec3d38-4ecb-4eb9-a976-ff48d74adb13 req-2454f68c-bf68-4af4-8105-ad0e0c233263 service nova] Creating event network-changed:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:32:52.268142 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:52.268695 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:52.271010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-94ec3d38-4ecb-4eb9-a976-ff48d74adb13 req-2454f68c-bf68-4af4-8105-ad0e0c233263 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034546 Jul 28 06:32:52.271609 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 323/656] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:52.271916 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:52.272366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:52.720374 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:52.728072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d9a8c725-8d2a-487e-98c1-70ef13c6f031 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1666 microversion: 2.1 time: 0.481028 Jul 28 06:32:52.728965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 334/657] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:52 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1666 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:52.792613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:52.793362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:52.800539 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:52.800978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:52.801836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:52.802267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:53.070625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:53.079731 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-838d597f-46b0-463c-9bf8-15b5779b2e77 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.291185 Jul 28 06:32:53.080320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 324/658] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:52 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:54.103892 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:54.105360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:54.113356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:54.113872 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:54.114648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:54.115406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:54.258437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:54.265937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-aa939576-fb65-4e31-90a6-183a89174ec5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.166400 Jul 28 06:32:54.266511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 335/659] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:54 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:54.287507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-ee92ff40-3e41-45b6-bb04-c40530408aa5 req-a7322b38-9f70-4d08-a764-f3668c264d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf2285f-4557-4371-ada3-e9282cca6137", "tag": "d0641c22-d0c9-47a3-afc2-33464fcd85c8"}, {"name": "network-changed", "server_uuid": "da8c072e-b6c3-486f-9755-c32b99e783f7", "tag": "e32626bb-30e6-43a9-9be6-672349e56fb4"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:32:54.299658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-ee92ff40-3e41-45b6-bb04-c40530408aa5 req-a7322b38-9f70-4d08-a764-f3668c264d30 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:54.300194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-ee92ff40-3e41-45b6-bb04-c40530408aa5 req-a7322b38-9f70-4d08-a764-f3668c264d30 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:54.313454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-ee92ff40-3e41-45b6-bb04-c40530408aa5 req-a7322b38-9f70-4d08-a764-f3668c264d30 service nova] Creating event network-changed:d0641c22-d0c9-47a3-afc2-33464fcd85c8 for instance dbf2285f-4557-4371-ada3-e9282cca6137 on hv-cinder-81242 Jul 28 06:32:54.314070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-ee92ff40-3e41-45b6-bb04-c40530408aa5 req-a7322b38-9f70-4d08-a764-f3668c264d30 service nova] Creating event network-changed:e32626bb-30e6-43a9-9be6-672349e56fb4 for instance da8c072e-b6c3-486f-9755-c32b99e783f7 on hv-cinder-81242 Jul 28 06:32:54.320883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-ee92ff40-3e41-45b6-bb04-c40530408aa5 req-a7322b38-9f70-4d08-a764-f3668c264d30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037076 Jul 28 06:32:54.321809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 325/660] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:32:55.288781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:55.288781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:55.290432 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:55.295035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:55.295479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:55.296243 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:55.296675 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:55.711102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:55.719544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bd9aae95-1bbb-4f7b-b2d1-a27d790f48e0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.436658 Jul 28 06:32:55.720424 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 336/661] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:55 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:56.740881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:56.741504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:56.743427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:56.744103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:32:56.750774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:56.751215 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:56.752022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:56.752448 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:56.891321 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:56.898902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-eb0bd9e8-6630-4142-ae93-000977e0e12f tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.162557 Jul 28 06:32:56.899474 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 326/662] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:56 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:57.921542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:57.922148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:57.928642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:57.929084 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:57.930033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:57.930305 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:58.064731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:58.072191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e202c161-e054-4976-831c-74ea873d3d1b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.155248 Jul 28 06:32:58.072769 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 337/663] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:57 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:32:59.094555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:32:59.095175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:32:59.101720 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:59.102163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:59.102926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:32:59.103362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:32:59.233732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:32:59.241318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e667c074-2a12-4ca1-af74-5ad222bcb9f0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.150828 Jul 28 06:32:59.241909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 327/664] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:32:59 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:00.263464 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:00.264213 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:00.271167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:00.271648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:00.272489 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:00.273026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:00.418850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:00.426607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-86824a8f-347d-4559-90c3-018d5b19b3fd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.167914 Jul 28 06:33:00.427192 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 338/665] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:00 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:01.390571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1823690831", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "networks": [{"uuid": "50175450-6f2f-4aa2-9ede-88b996d979b0"}]}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:01.443881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] validate_networks() for [('50175450-6f2f-4aa2-9ede-88b996d979b0', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:33:01.447219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:01.447866 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:01.455247 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:01.455708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:01.456481 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:01.456925 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:01.648827 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:01.657168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-90794e04-6f0e-4a0a-b9a7-8d5874c34126 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.213659 Jul 28 06:33:01.657890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 339/666] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:01 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:01.861759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:33:01.862184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:33:01.862661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:33:01.863067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:33:01.863510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:33:01.873068 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:01.873552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:01.874349 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:01.874788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:01.891121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Getting quotas for project f33d1845b3b643b99b066eaeee429e12. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:33:01.895049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Getting quotas for user 97547d56a8684009a794a42ad1c5f489 and project f33d1845b3b643b99b066eaeee429e12. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:33:01.907276 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:33:01.909626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:33:02.040562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-02cb45c1-6fe5-4396-90ad-cd70c2e62f99 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654400 Jul 28 06:33:02.041296 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 328/667] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:33:02.052693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4fd68fb2-d10d-4368-84dd-7cc0f7242ed7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:02.053326 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4fd68fb2-d10d-4368-84dd-7cc0f7242ed7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:02.110481 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4fd68fb2-d10d-4368-84dd-7cc0f7242ed7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:02.124710 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4fd68fb2-d10d-4368-84dd-7cc0f7242ed7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1219 microversion: 2.1 time: 0.075706 Jul 28 06:33:02.125448 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 340/668] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:02 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:02.604159 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-10e75061-6fe4-4268-a444-996adf0e4ddf req-01c71b24-4c80-4874-9819-73135ac22888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf2285f-4557-4371-ada3-e9282cca6137", "name": "network-vif-plugged", "status": "completed", "tag": "d0641c22-d0c9-47a3-afc2-33464fcd85c8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:02.615404 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-10e75061-6fe4-4268-a444-996adf0e4ddf req-01c71b24-4c80-4874-9819-73135ac22888 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:02.616047 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-10e75061-6fe4-4268-a444-996adf0e4ddf req-01c71b24-4c80-4874-9819-73135ac22888 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:02.621405 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:02.627168 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-10e75061-6fe4-4268-a444-996adf0e4ddf req-01c71b24-4c80-4874-9819-73135ac22888 service nova] Creating event network-vif-plugged:d0641c22-d0c9-47a3-afc2-33464fcd85c8 for instance dbf2285f-4557-4371-ada3-e9282cca6137 on hv-cinder-81242 Jul 28 06:33:02.632075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-10e75061-6fe4-4268-a444-996adf0e4ddf req-01c71b24-4c80-4874-9819-73135ac22888 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Jul 28 06:33:02.635746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 329/669] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:02.678897 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:02.680161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:02.687277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:02.687750 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:02.688523 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:02.688952 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:02.836697 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:02.845406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5cc4f12f-646b-4c85-b871-3fb9aa08df3c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.170360 Jul 28 06:33:02.845986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 341/670] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:02 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:03.147187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:03.147885 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:03.155263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:03.157384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:03.157384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:03.157384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:03.218977 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:03.226309 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0a44707c-ae31-4995-a06b-d2b9f7471380 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1223 microversion: 2.1 time: 0.083747 Jul 28 06:33:03.226889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 330/671] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:03 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:03.867388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:03.868045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:03.875448 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:03.875893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:03.876653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:03.877087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.008717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:04.016425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7d8c83fb-cad2-4dd5-ac9b-d06b4da53a8d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1366 microversion: 2.1 time: 0.152830 Jul 28 06:33:04.017008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 342/672] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:03 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:04.235772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:04.235772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:04.242046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.242500 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.243269 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.243867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.247717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:04.248325 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:04.254402 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.254826 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.255586 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.256019 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.276407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-62c6c671-2a7f-4e1e-8259-2def504def5b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments/e093260b-4719-4d61-8e26-e24c463e7b4c" status: 200 len: 194 microversion: 2.20 time: 0.045705 Jul 28 06:33:04.277184 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 331/673] 10.222.0.69 () {60 vars in 1454 bytes} [Thu Jul 28 06:33:04 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments/e093260b-4719-4d61-8e26-e24c463e7b4c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:33:04.318697 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:04.328773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9e6311ea-bfa2-4b24-b82f-8d5903f5a624 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1271 microversion: 2.1 time: 0.083733 Jul 28 06:33:04.328773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 343/674] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:04 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:04.346999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:04.347491 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:04.353703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.354150 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.354913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.355399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.440203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lazy-loading 'services' on Instance uuid dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:33:04.661123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-35eb80c9-4622-4299-948c-f8ee89fec91b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments/e093260b-4719-4d61-8e26-e24c463e7b4c" status: 202 len: 0 microversion: 2.20 time: 0.317903 Jul 28 06:33:04.661750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 332/675] 10.222.0.69 () {60 vars in 1457 bytes} [Thu Jul 28 06:33:04 2022] DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments/e093260b-4719-4d61-8e26-e24c463e7b4c => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:33:04.670977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:04.673241 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:04.679329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.679784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.680554 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:04.680992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:04.710415 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0f08411d-afbb-4532-82cc-b8fc04a2c472 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044155 Jul 28 06:33:04.710976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 344/676] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Jul 28 06:33:04 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:33:05.038426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:05.038960 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:05.046573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.047101 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.047886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.048323 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.269956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:05.277452 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ec99c44c-0f24-4143-a0f4-97e40c59abd5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1557 microversion: 2.1 time: 0.243475 Jul 28 06:33:05.278029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 333/677] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:05 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1557 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:05.299076 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:05.299678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:05.306615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.307070 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.307873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.308303 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.348213 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:05.348821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:05.354986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.355431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.356192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.357186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.395727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3b0da79f-c697-405b-a942-c2c00f48f061 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100214 Jul 28 06:33:05.395727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 345/678] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:33:05 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:05.433848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:05.442503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-28e28068-2cf3-4192-a527-81254f366075 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1279 microversion: 2.1 time: 0.098165 Jul 28 06:33:05.443495 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 334/679] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:05 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:05.723291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:05.725852 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:05.732705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.733148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.734276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:05.738969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:05.768330 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a46894d6-c37f-430e-a54a-0f21ee7279c4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048814 Jul 28 06:33:05.768913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 346/680] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Jul 28 06:33:05 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:33:06.433747 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-d63d2164-be24-46b1-9933-209dcdfb7203 req-1d4a1de0-d028-4754-9210-dc88968e9bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf2285f-4557-4371-ada3-e9282cca6137", "tag": "d0641c22-d0c9-47a3-afc2-33464fcd85c8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:06.443894 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d63d2164-be24-46b1-9933-209dcdfb7203 req-1d4a1de0-d028-4754-9210-dc88968e9bc8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.447655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d63d2164-be24-46b1-9933-209dcdfb7203 req-1d4a1de0-d028-4754-9210-dc88968e9bc8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.456129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-d63d2164-be24-46b1-9933-209dcdfb7203 req-1d4a1de0-d028-4754-9210-dc88968e9bc8 service nova] Creating event network-changed:d0641c22-d0c9-47a3-afc2-33464fcd85c8 for instance dbf2285f-4557-4371-ada3-e9282cca6137 on hv-cinder-81242 Jul 28 06:33:06.461006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-d63d2164-be24-46b1-9933-209dcdfb7203 req-1d4a1de0-d028-4754-9210-dc88968e9bc8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030849 Jul 28 06:33:06.462297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 335/681] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:06.467393 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:06.468126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:06.482803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.483271 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.484061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.484541 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.781120 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:06.783584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:06.790194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.790922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.791720 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.792158 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.824475 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-68a451f1-7a22-4ee0-8939-357a2f08a475 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047907 Jul 28 06:33:06.825819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 336/682] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Jul 28 06:33:06 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:06.894481 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:06.894988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:06.901621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.902072 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.902850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:06.903317 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:06.929994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:33:07.039809 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:07.050401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2cabe875-3650-45b1-ad2d-2c22ea28aa9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.589889 Jul 28 06:33:07.052228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 347/683] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:06 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:07.247840 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-44fdb63e-c119-4290-947f-c537ae3d8738 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 204 len: 0 microversion: 2.20 time: 0.356816 Jul 28 06:33:07.249457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 337/684] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Jul 28 06:33:06 2022] DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 06:33:07.258400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:07.259006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:07.266350 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:07.266789 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:07.267574 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:07.268166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:07.420051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-ec9373c9-93c1-410e-a082-ea0eddeae231 req-6d58b509-f290-4072-be66-b85d12e8db56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce", "tag": "d97de84a-a166-4184-81ca-48cdf759ec0d"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:07.430121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-ec9373c9-93c1-410e-a082-ea0eddeae231 req-6d58b509-f290-4072-be66-b85d12e8db56 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:07.430690 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-ec9373c9-93c1-410e-a082-ea0eddeae231 req-6d58b509-f290-4072-be66-b85d12e8db56 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:07.443770 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-ec9373c9-93c1-410e-a082-ea0eddeae231 req-6d58b509-f290-4072-be66-b85d12e8db56 service nova] Creating event network-changed:d97de84a-a166-4184-81ca-48cdf759ec0d for instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce on hv-cinder-81242 Jul 28 06:33:07.449988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-ec9373c9-93c1-410e-a082-ea0eddeae231 req-6d58b509-f290-4072-be66-b85d12e8db56 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034729 Jul 28 06:33:07.450685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 338/685] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:33:07.483993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:07.492868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:07.494913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:07.496457 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-56d064d7-6c34-41f2-ad52-e8c1fcb32d4e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.243462 Jul 28 06:33:07.497759 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 348/686] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:07 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:08.073267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:08.073987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:08.080900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:08.081377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:08.082149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:08.082585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:08.220792 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:08.228289 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4bd6b674-99af-40b6-852b-d9b9a3e8a69c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.159198 Jul 28 06:33:08.230884 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 339/687] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:08 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:08.521275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:08.521942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:08.528479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:08.528934 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:08.529736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:08.530174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:08.532920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=100 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:08.788020 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:08.796831 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:08.798362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:08.799525 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f1bc98e8-17c8-49dd-953a-cad34fbe8ad3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.282246 Jul 28 06:33:08.800089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 349/688] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:08 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:09.250199 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:09.254737 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:09.257696 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:09.258193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:09.258967 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:09.259404 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:09.732716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:09.740593 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0b2c871c-758f-4b14-be85-7efb2403010b tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.495125 Jul 28 06:33:09.741339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 340/689] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:09 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:09.821504 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:09.822165 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:09.829345 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:09.829863 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:09.830649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:09.831088 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:10.154051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:10.161929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:10.163429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:10.164649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-207a1c09-e921-4407-9fb4-912201a907d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1724 microversion: 2.20 time: 0.347139 Jul 28 06:33:10.165246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 350/690] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:09 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:10.763911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:10.764579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:10.771710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:10.772166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:10.772947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:10.773425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:10.775470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-030b7124-911c-44f1-b749-24cc35e3b4ce req-3ca9ce0e-bb4b-46d2-b0af-ab4bdbead2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e", "name": "network-vif-deleted", "tag": "0d2efce0-28f9-47ea-a49a-15a80e72550a"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:10.787147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-030b7124-911c-44f1-b749-24cc35e3b4ce req-3ca9ce0e-bb4b-46d2-b0af-ab4bdbead2b1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:10.787597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-030b7124-911c-44f1-b749-24cc35e3b4ce req-3ca9ce0e-bb4b-46d2-b0af-ab4bdbead2b1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:10.799439 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-030b7124-911c-44f1-b749-24cc35e3b4ce req-3ca9ce0e-bb4b-46d2-b0af-ab4bdbead2b1 service nova] Creating event network-vif-deleted:0d2efce0-28f9-47ea-a49a-15a80e72550a for instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e on hv-cinder-81242 Jul 28 06:33:10.804818 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-030b7124-911c-44f1-b749-24cc35e3b4ce req-3ca9ce0e-bb4b-46d2-b0af-ab4bdbead2b1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032891 Jul 28 06:33:10.809593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 351/691] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:33:10.918041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:10.926136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-35c0b5ae-ce6b-489c-ad8a-52e24b2711a1 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.167384 Jul 28 06:33:10.937336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 341/692] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:10 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:11.189170 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:11.190006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:11.196585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:11.197116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:11.198010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:11.198452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:11.266755 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:11.275259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:11.291082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:11.291082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-06b9d348-b646-45bb-ada2-94081e91785a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1657 microversion: 2.20 time: 0.093150 Jul 28 06:33:11.291082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 352/693] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:11 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:33:11.952236 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:11.955877 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:11.958797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:11.959468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:11.961167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:11.962097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:11.962885 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:11.963324 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:12.097185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:12.104745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e2eb5f50-4f32-470b-8253-013016950d2d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.157107 Jul 28 06:33:12.105327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 342/694] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:11 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:12.301145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:12.301727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:12.303791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:12.309290 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:12.310401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:12.311187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:12.311632 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:12.346664 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:12.347158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:12.347619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lazy-loading 'fault' on Instance uuid dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:33:12.390275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:12.398590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:12.403706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:12.403706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2cd31575-bab6-410c-848a-9b6092a005f2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 200 len: 1372 microversion: 2.20 time: 0.104130 Jul 28 06:33:12.403706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 353/695] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:12 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:13.126997 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:13.127614 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:13.135260 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:13.135707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:13.136462 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:13.136899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:13.269382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:13.276863 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b0f0681c-0ee6-4c32-b99c-2a8e1a598a40 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.154238 Jul 28 06:33:13.277461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 343/696] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:13 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:13.425154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:13.425765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:13.428035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:13.432821 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:13.433268 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:13.438467 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:13.438467 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:13.448110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] HTTP exception thrown: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Request method failure captured: Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e HTTP/1.1 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyLAhONqwdvmcvpgSBT7hHbZDiWHN0vv_53aIAXx7mJga4bkT1xNH2Zp0xQ18hvT_8NZ2J5c4rMymS90gjEKFhm4j0AdUn-1UqWbFzwOCTahDBexx-Vc1_PIxvHTMZXZlPy_gYz36rOo4MSR74loe2014Q9bJ-gDwbcUoG9TzaS28w Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:33:13.449792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a164b3cd6f444e17ae7ada0e30e62f54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}] Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 6d4528589ffa478689e905d47e4c37ee Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:33:13.452288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e'} Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:33:13.453212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:33:13.454693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:13.455982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Returning 404 to user: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:33:13.455982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0560598f-bb53-40b5-ac51-563d59956b70 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 404 len: 111 microversion: 2.20 time: 0.030956 Jul 28 06:33:13.455982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 354/697] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:13 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:33:13.461007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2bf8cb36-469d-4663-a79d-641e316bf926 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '.version_select at 0x7fbe61cd9700>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:13.534279 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2bf8cb36-469d-4663-a79d-641e316bf926 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600114702" status: 204 len: 0 microversion: 2.20 time: 0.077051 Jul 28 06:33:13.534924 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 344/698] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Jul 28 06:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1600114702 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 06:33:14.269471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f995f1f4-eba1-4cf5-9b52-8b650b6657cd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'create', calling method: .version_select at 0x7fbe61bb5040>, body: {"keypair": {"name": "tempest-keypair-1572317512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImy+8g8Fo8qlvJT/gilccLB+KF6Tr5MZV0NZVKtWilAi1ORz1rf4ejXf8GdCerIqba5Sx99twEWqCiPWMeqCLwMc5JYUKOxUl5ZOKct3gUw9fHe1oJ+PGgNKuEq61Wa9w=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:14.285440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f995f1f4-eba1-4cf5-9b52-8b650b6657cd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:33:14.289376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-f995f1f4-eba1-4cf5-9b52-8b650b6657cd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for user 6d4528589ffa478689e905d47e4c37ee and project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:33:14.298412 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:14.299039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:14.305834 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:14.306555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:14.307079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:14.307519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:14.380870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f995f1f4-eba1-4cf5-9b52-8b650b6657cd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.115149 Jul 28 06:33:14.381427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 355/699] 10.222.0.69 () {62 vars in 1200 bytes} [Thu Jul 28 06:33:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 06:33:14.444846 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:14.453059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ca5f25c7-9318-4c5d-bb62-88344f99868c tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.159668 Jul 28 06:33:14.453702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 345/700] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:14 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:15.484362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:15.485029 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:15.492116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:15.492569 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:15.493401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:15.493850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:15.811773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:15.819806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-21647c0a-f4eb-4062-8011-44f084d52911 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.340068 Jul 28 06:33:15.820615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 356/701] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:15 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:16.655865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-fc7892b1-9a62-4522-9e39-b3ed542f8627 req-7627e77d-8684-4e14-bb01-af80b3a01590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce", "name": "network-vif-plugged", "status": "completed", "tag": "d97de84a-a166-4184-81ca-48cdf759ec0d"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:16.667517 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-fc7892b1-9a62-4522-9e39-b3ed542f8627 req-7627e77d-8684-4e14-bb01-af80b3a01590 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:16.668012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-fc7892b1-9a62-4522-9e39-b3ed542f8627 req-7627e77d-8684-4e14-bb01-af80b3a01590 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:16.680087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-fc7892b1-9a62-4522-9e39-b3ed542f8627 req-7627e77d-8684-4e14-bb01-af80b3a01590 service nova] Creating event network-vif-plugged:d97de84a-a166-4184-81ca-48cdf759ec0d for instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce on hv-cinder-81242 Jul 28 06:33:16.685496 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-fc7892b1-9a62-4522-9e39-b3ed542f8627 req-7627e77d-8684-4e14-bb01-af80b3a01590 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033785 Jul 28 06:33:16.686264 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 346/702] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:16.843114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:16.843868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:16.855981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:16.856436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:16.857794 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:16.860864 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:17.068526 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:17.076251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-201312a6-f883-4a1e-a9c7-5193fda352df tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.237087 Jul 28 06:33:17.076745 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 357/703] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:16 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:17.380498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1346378303", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5e9eeda-6e9e-4dd6-a6c3-14c5caf4bc34"}], "security_groups": [{"name": "tempest-securitygroup--1610931444"}], "key_name": "tempest-keypair-1572317512", "user_data": "}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:17.484662 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] validate_networks() for [('b5e9eeda-6e9e-4dd6-a6c3-14c5caf4bc34', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:33:17.862859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:33:17.863466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:33:17.863736 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:33:17.864167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:33:17.864571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:33:17.873947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:17.874417 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:17.875204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:17.875634 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:17.882263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:17.893543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:33:17.903134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Getting quotas for user 6d4528589ffa478689e905d47e4c37ee and project a164b3cd6f444e17ae7ada0e30e62f54. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:33:17.908645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:33:17.911009 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:33:18.050004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7eeb24be-9ce4-4341-8238-4fb325bb4a1d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.674211 Jul 28 06:33:18.050885 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 347/704] 10.222.0.69 () {62 vars in 1188 bytes} [Thu Jul 28 06:33:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 06:33:18.062585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-72de5c7b-c8b9-4bf5-9028-9c2747625008 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:18.063259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-72de5c7b-c8b9-4bf5-9028-9c2747625008 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:18.102478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:18.103092 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:18.111119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:18.111569 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:18.112340 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:18.112771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:18.121428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-72de5c7b-c8b9-4bf5-9028-9c2747625008 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:18.130441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-72de5c7b-c8b9-4bf5-9028-9c2747625008 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:18.131989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-72de5c7b-c8b9-4bf5-9028-9c2747625008 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:18.133769 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-72de5c7b-c8b9-4bf5-9028-9c2747625008 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1282 microversion: 2.20 time: 0.075876 Jul 28 06:33:18.140282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 358/705] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:18 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:18.254704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:18.262125 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-267efec9-9654-458e-b8af-55eb387c5418 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1319 microversion: 2.1 time: 0.167528 Jul 28 06:33:18.262689 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 348/706] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:18 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:19.156597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:19.157199 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:19.164451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:19.165167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:19.165718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:19.166168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:19.229796 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:19.238239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:19.239793 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:19.245626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5d274dcd-4a38-46e6-ae7e-b02a93b7ce99 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1286 microversion: 2.20 time: 0.088447 Jul 28 06:33:19.245626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 359/707] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:19 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:19.282356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:19.282977 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:19.289432 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:19.289873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:19.290618 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:19.291047 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:19.424418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:19.431898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cf1a76fe-e978-49b5-bbd2-d86c7510e93d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1507 microversion: 2.1 time: 0.153376 Jul 28 06:33:19.432460 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 349/708] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:19 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:19.454147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3eca18c4-b19f-43d1-8865-58cb337efd67", "device": "/dev/sdb"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:19.456580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:19.462915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:19.463360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:19.464118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:19.464554 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:20.264132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:20.265336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:20.267178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:20.272021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:20.272473 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:20.273248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:20.273737 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:20.350228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:20.357530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:20.359303 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:20.360465 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c7772a1c-c8f4-4962-992d-3524505fbdcb tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1342 microversion: 2.20 time: 0.100487 Jul 28 06:33:20.361092 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 350/709] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:20 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:33:20.697102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4fde780e-9248-4437-a475-fb54fe99366e tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "POST /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.247483 Jul 28 06:33:20.697868 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 360/710] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:33:19 2022] POST /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce/os-volume_attachments => generated 194 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:21.383853 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:21.384459 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:21.391497 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:21.391944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:21.392714 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:21.393144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:21.588362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:21.596996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:21.598514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:21.603418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ef3b0c19-6246-4ea8-bf1e-de7cf8e2b5f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.220097 Jul 28 06:33:21.603418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 351/711] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:21 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:22.065297 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-b1a15895-41f7-4363-926d-32e53fc3e0af req-7b797a86-28f5-4e57-ab12-ca0cbdc586f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:22.080287 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-b1a15895-41f7-4363-926d-32e53fc3e0af req-7b797a86-28f5-4e57-ab12-ca0cbdc586f6 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:22.085288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-b1a15895-41f7-4363-926d-32e53fc3e0af req-7b797a86-28f5-4e57-ab12-ca0cbdc586f6 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:22.095103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-b1a15895-41f7-4363-926d-32e53fc3e0af req-7b797a86-28f5-4e57-ab12-ca0cbdc586f6 service nova] Creating event network-changed:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:33:22.100299 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-b1a15895-41f7-4363-926d-32e53fc3e0af req-7b797a86-28f5-4e57-ab12-ca0cbdc586f6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040429 Jul 28 06:33:22.101136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 361/712] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:22.624526 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:22.625169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:22.632011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:22.632465 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:22.633240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:22.633707 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:22.868071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:22.877179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:22.878726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:22.890123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-17d90abf-3a6d-4709-bb5c-c3368ff3ecb2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.259767 Jul 28 06:33:22.895017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 352/713] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:22 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:23.904038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:23.904756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:23.911194 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:23.911639 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:23.912421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:23.912855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:24.068027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:24.076845 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:24.078411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:24.079721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-71196ff4-9da1-4029-a44a-ef6dcedec6b7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.180995 Jul 28 06:33:24.080299 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 362/714] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:23 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:25.101676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:25.102605 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:25.109068 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:25.109771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:25.110318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:25.110757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:25.245836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:25.255983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:25.257504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:25.258648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cb73428a-b0ed-4840-8181-2f0f1859d858 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.160967 Jul 28 06:33:25.259203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 353/715] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:25 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:26.282522 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:26.283066 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:26.289692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:26.290143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:26.290917 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:26.291361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:26.423783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:26.431667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:26.439985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:26.439985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1b5cb9e5-1703-4934-a55a-73cc50449b2f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.156388 Jul 28 06:33:26.439985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 363/716] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:26 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:33:27.457546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:27.458211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:27.464846 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:27.465284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:27.466058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:27.466483 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:27.598683 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:27.606593 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:27.608156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:27.609421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-791aea92-e14e-477c-b5e8-5c2aec9b5d1e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.155737 Jul 28 06:33:27.609917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 354/717] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:27 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:28.363601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:28.368032 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:28.368032 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:28.372032 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.372538 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.373336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.374472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.456041 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lazy-loading 'services' on Instance uuid 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:33:28.634308 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:28.635073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=6 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:28.693978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:28.694596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:28.700589 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.701038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.701891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.702333 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.705561 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-56bf32d8-e95a-45ff-b996-6f8274f755ff tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments/fd931a90-8726-46c3-9227-dc2ba1ebf160" status: 202 len: 0 microversion: 2.1 time: 0.345701 Jul 28 06:33:28.711024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 364/718] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:33:28 2022] DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments/fd931a90-8726-46c3-9227-dc2ba1ebf160 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:33:28.718162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:28.721798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:28.728781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.729650 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.730580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.731451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.771179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf384154-ebe1-4e7e-976c-ca80839cdfc0 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060116 Jul 28 06:33:28.771748 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 365/719] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:28 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:28.776638 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-ec753a5c-3768-4278-9394-cb28d352e105 req-8e2567ba-f191-4634-8112-d8911f673f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "name": "network-vif-plugged", "status": "completed", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:28.786409 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ec753a5c-3768-4278-9394-cb28d352e105 req-8e2567ba-f191-4634-8112-d8911f673f23 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:28.786859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ec753a5c-3768-4278-9394-cb28d352e105 req-8e2567ba-f191-4634-8112-d8911f673f23 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:28.799211 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-ec753a5c-3768-4278-9394-cb28d352e105 req-8e2567ba-f191-4634-8112-d8911f673f23 service nova] Creating event network-vif-plugged:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:33:28.804271 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-ec753a5c-3768-4278-9394-cb28d352e105 req-8e2567ba-f191-4634-8112-d8911f673f23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Jul 28 06:33:28.804932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 366/720] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:28.848772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:28.857657 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:28.860783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:28.862154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-59db2031-84bf-421f-b5ca-f39400f43af6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.233940 Jul 28 06:33:28.871615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 355/721] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:28 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:33:29.696380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:33:29.696928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Thu Jul 28 06:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:33:29.784853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:29.787229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:29.793914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:29.794366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:29.795130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:29.795671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:29.824387 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-08d26dd6-0955-4f26-9be0-ef98e43a5c4d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044489 Jul 28 06:33:29.824941 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 367/722] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:29 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:29.885033 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:29.885615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:29.893866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:29.894321 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:29.895086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:29.895526 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:30.023461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:30.032361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:30.033901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:30.035021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0ae98bae-b999-4af3-8af8-e562cf609ef4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.154011 Jul 28 06:33:30.035848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 356/723] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:29 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:30.837724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:30.839856 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:30.846914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:30.847356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:30.848135 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:30.848567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:30.850906 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:30.878740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-da65041d-b809-496e-b854-1f762303a1c7 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Jul 28 06:33:30.879292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 368/724] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:30 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:31.058961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:31.059567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:31.067683 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:31.068131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:31.068907 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:31.069370 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:31.214748 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:31.223197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:31.224695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:31.225832 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ccc356f3-e613-4558-aca6-aafedebb68fc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.170899 Jul 28 06:33:31.226388 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 357/725] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:31 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:31.891500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:31.893660 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:31.900379 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:31.900874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:31.901664 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:31.902099 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:31.932255 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3e4eef5b-ad44-49f0-b973-3d0433d2f1c1 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Jul 28 06:33:31.932818 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 369/726] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:31 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:32.249185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:32.249833 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:32.256413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:32.256859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:32.262025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:32.262025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:32.397622 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:32.405625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:32.407146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:32.408260 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-440075a8-7290-4c8a-a21d-89ac658d337f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.163744 Jul 28 06:33:32.408814 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 358/727] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:32 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:32.946080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:32.948225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:32.955330 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:32.955784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:32.956556 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:32.956995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:32.986791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea190482-19ff-45f7-838d-1a17a9ce9996 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Jul 28 06:33:32.987366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 370/728] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:32 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:33.430455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:33.431053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:33.437286 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:33.438263 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:33.439016 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:33.439443 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:33.569420 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:33.577331 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:33.579648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:33.580744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b69a3051-bdf4-4972-b2c3-3c6e3e6c720a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.154182 Jul 28 06:33:33.581293 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 359/729] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:33 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:33.999201 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:34.002009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:34.008538 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.009136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.010182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.010628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.040796 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a67ab452-9cfb-4aaf-8941-d613bd6ad880 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045475 Jul 28 06:33:34.041385 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 371/730] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:33 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:33:34.125228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:34.125753 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:34.131938 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.132396 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.133166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.133633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.160786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:33:34.401981 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6213a7f1-5f68-4f8a-af43-39389fc5da3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 204 len: 0 microversion: 2.1 time: 0.280230 Jul 28 06:33:34.402578 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 360/731] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:33:34 2022] DELETE /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:33:34.411282 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:34.414361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:34.417890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.418335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.419091 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.419519 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.553340 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:34.560991 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d82bd698-96de-468f-83e4-31195cf1e242 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.153549 Jul 28 06:33:34.561696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 372/732] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:34 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:34.603739 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:34.604425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:34.611240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.611722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.612481 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:34.612909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:34.751928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:34.760241 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:34.761768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:34.762882 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e8db55f2-0c10-4f0e-bf4a-f5e6f48c9157 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.163403 Jul 28 06:33:34.763439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 361/733] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:34 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:35.582677 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:35.583365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:35.589979 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:35.590422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:35.591171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:35.591605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:35.722243 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:35.729614 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3072b591-9275-439d-958b-13fa6274ca3f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.150799 Jul 28 06:33:35.735564 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 373/734] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:35 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:35.787277 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:35.787805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:35.794400 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:35.794846 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:35.795597 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:35.796028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:35.928640 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:35.930931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:35.937170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:35.941759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:35.941759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cf3ee3a4-3b61-430d-b8ec-ecb97fa7cf03 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1408 microversion: 2.20 time: 0.156523 Jul 28 06:33:35.941759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 362/735] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:35 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:36.751301 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:36.751918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:36.758474 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:36.758928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:36.759700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:36.760138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:36.894119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:36.902459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-65565f91-9ac7-442d-8d4c-312834e2c28b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.155819 Jul 28 06:33:36.903027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 374/736] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:36 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:36.963712 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:36.964468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:36.974514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:36.974514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:36.974514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:36.974514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:36.999762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:37.002755 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:37.008958 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.009446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.010212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.010649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.042125 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-156eb56f-6c9b-4fec-a6d4-13df44650157 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046347 Jul 28 06:33:37.042738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 375/737] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:33:36 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:33:37.108145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:37.108649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:37.115543 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.115994 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.116775 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:37.116928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.117243 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.126857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:37.128891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:37.130127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-76865ee1-3596-4d3f-b7fb-92b1ed2e2106 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1599 microversion: 2.20 time: 0.171021 Jul 28 06:33:37.130697 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 363/738] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:33:36 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:33:37.143486 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:33:37.152254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:37.152866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:37.159712 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.160245 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.161090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.161647 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.242797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-94b54900-cfe3-44f9-9398-b61f1f06bbc3 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094298 Jul 28 06:33:37.243568 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 364/739] 10.222.0.69 () {60 vars in 1316 bytes} [Thu Jul 28 06:33:37 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:33:37.499580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6f55f287-eb84-4aea-94fd-688f435b41ea tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 204 len: 0 microversion: 2.1 time: 0.394963 Jul 28 06:33:37.500862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 376/740] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:33:37 2022] DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:33:37.519301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:37.519301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:37.519301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.519301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.520042 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.520042 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.653173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:37.662384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-55e5cd84-d5e6-4805-b4fb-68bc6e94aabd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.156295 Jul 28 06:33:37.663143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 365/741] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:37 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:37.926614 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:37.927347 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:37.934254 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.934707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:37.935493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:37.935938 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:38.080304 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:38.088509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d6da9238-23d7-4488-9d16-017a06ca3990 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.168099 Jul 28 06:33:38.089088 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 377/742] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:37 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:38.488519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-79d679b6-f46b-42ce-bbbd-cca080fd6fcd req-97b0fbbb-3a21-480d-88d7-2e9effc6f0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:38.498442 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-79d679b6-f46b-42ce-bbbd-cca080fd6fcd req-97b0fbbb-3a21-480d-88d7-2e9effc6f0cd service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:38.498883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-79d679b6-f46b-42ce-bbbd-cca080fd6fcd req-97b0fbbb-3a21-480d-88d7-2e9effc6f0cd service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:38.510493 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-79d679b6-f46b-42ce-bbbd-cca080fd6fcd req-97b0fbbb-3a21-480d-88d7-2e9effc6f0cd service nova] Creating event network-changed:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:33:38.516486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-79d679b6-f46b-42ce-bbbd-cca080fd6fcd req-97b0fbbb-3a21-480d-88d7-2e9effc6f0cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031040 Jul 28 06:33:38.517469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 366/743] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:38.684153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:38.684781 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:38.692447 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:38.693048 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:38.694159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:38.694696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:38.831788 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:38.839720 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cc09165d-512c-4ac3-8930-5022576b2345 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.159430 Jul 28 06:33:38.840317 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 378/744] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:38 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:39.112331 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:39.113034 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:39.119648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:39.120096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:39.120897 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:39.122016 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:39.256924 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:39.270526 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4f1419a7-bf7e-4e65-8dcb-423b59250ab9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.163189 Jul 28 06:33:39.271099 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 367/745] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:39 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:39.861607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:39.862216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:39.868511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:39.868891 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:39.869676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:39.870103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:40.003913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:40.011520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c5262db7-a71c-4393-ad7e-bb69b4e908b2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.154329 Jul 28 06:33:40.012093 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 379/746] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:39 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:40.292736 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:40.293369 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:40.303473 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:40.308363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:40.308363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:40.308363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:40.440886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:40.448360 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-51db0566-b115-485c-b9c4-4e8be00a7f3e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.159485 Jul 28 06:33:40.448924 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 368/747] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:40 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:40.780267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:40.780767 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:40.787557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:40.788008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:40.788772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:40.789211 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:40.870097 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lazy-loading 'services' on Instance uuid 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:33:41.033048 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:41.033694 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:41.040036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:41.040483 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:41.041249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:41.041713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:41.089146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-119e5b3b-8edd-4a20-9d6d-a8db8d7eca9a tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce/os-volume_attachments/3eca18c4-b19f-43d1-8865-58cb337efd67" status: 202 len: 0 microversion: 2.1 time: 0.312597 Jul 28 06:33:41.090046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 380/748] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:33:40 2022] DELETE /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce/os-volume_attachments/3eca18c4-b19f-43d1-8865-58cb337efd67 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:33:41.426635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:41.434102 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-de77ad6c-c9bc-4711-aec0-0248e2278fe2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.405203 Jul 28 06:33:41.434676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 369/749] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:41 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:41.470602 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:41.471290 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:41.477672 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:41.478118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:41.478873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:41.479312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:41.613256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:41.621229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c05d2c5d-161d-491a-ab8d-e67c0123df86 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.154616 Jul 28 06:33:41.621757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 381/750] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:41 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:42.455980 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:42.456521 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:42.463304 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:42.463755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:42.464512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:42.464937 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:42.601581 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:42.609910 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a6223ab5-093d-4064-b02b-97c711012619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.157184 Jul 28 06:33:42.610486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 370/751] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:42 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:42.643087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:42.643773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:42.650307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:42.650756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:42.651524 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:42.651967 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:42.667501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:42.783118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:42.790618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cca59bf3-2eb7-4cbb-a2bb-2d9d1ddbc921 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.151447 Jul 28 06:33:42.791191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 382/752] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:42 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:43.631135 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:43.631780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:43.638241 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:43.638722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:43.639487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:43.639932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:43.812097 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:43.813295 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:43.820599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:43.821389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:43.826117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:43.826117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:43.904803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:43.912547 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cea0cb5c-9ab2-4999-8ff3-b42553884619 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.285272 Jul 28 06:33:43.918209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 371/753] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:43 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:44.271735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:44.281948 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f1a6d44a-c8e5-42a7-8744-1e71556bc4e6 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.473041 Jul 28 06:33:44.293341 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 383/754] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:43 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:44.359045 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:44.364780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:44.365669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.366112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:44.367052 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.368264 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:44.394801 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:33:44.683126 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6dd07c85-fda3-4b8d-9bcc-e9449316b139 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "DELETE /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 204 len: 0 microversion: 2.1 time: 0.327713 Jul 28 06:33:44.684380 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 372/755] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:33:44 2022] DELETE /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:33:44.694541 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:44.695803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:44.701736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:44.705576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.706362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:44.707402 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.708097 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:44.737127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-59d82d58-0110-4a39-a746-6d3def2210c3 req-5f0c660b-dc85-4b6b-ae2b-d05970467a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "name": "network-vif-unplugged", "status": "completed", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:44.748564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-59d82d58-0110-4a39-a746-6d3def2210c3 req-5f0c660b-dc85-4b6b-ae2b-d05970467a3a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.749007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-59d82d58-0110-4a39-a746-6d3def2210c3 req-5f0c660b-dc85-4b6b-ae2b-d05970467a3a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:44.761478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-59d82d58-0110-4a39-a746-6d3def2210c3 req-5f0c660b-dc85-4b6b-ae2b-d05970467a3a service nova] Creating event network-vif-unplugged:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:33:44.768123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-59d82d58-0110-4a39-a746-6d3def2210c3 req-5f0c660b-dc85-4b6b-ae2b-d05970467a3a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041326 Jul 28 06:33:44.768832 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 373/756] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:33:44.934617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:44.935309 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:44.941969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.942410 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:44.944194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:44.944194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:45.155978 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:45.164086 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dda03964-68bc-451f-8e48-4170011a0a3d tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1513 microversion: 2.1 time: 0.474707 Jul 28 06:33:45.164768 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 384/757] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:44 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1513 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:45.250621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:45.258544 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fb96a40d-216d-47d0-abe2-49822aee516e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1672 microversion: 2.1 time: 0.328106 Jul 28 06:33:45.259160 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 374/758] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:44 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1672 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:45.317351 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:45.317874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:45.324229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:45.324673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:45.325515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:45.325969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:45.469182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:45.476944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dea726e1-8592-4971-8223-c7876cf41801 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1689 microversion: 2.1 time: 0.163546 Jul 28 06:33:45.477583 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 385/759] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:45 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:46.186644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:46.187818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:46.194685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.195209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.196087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.196592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.284616 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:46.285970 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:46.293879 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.295508 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.296843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.297513 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.433850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:46.445791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0eae7e02-5c16-4af1-bf3a-da6cc972535b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1604 microversion: 2.1 time: 0.169667 Jul 28 06:33:46.447035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 386/760] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:46 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:46.566044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-5b45911a-bc36-4a3e-9a48-5705bffbe710 req-d33015a4-3d3f-40b5-b552-2e8d07663c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028a5ad9-f35d-4c21-b9cb-8f9979d1e113", "name": "network-vif-deleted", "tag": "2742328d-a56f-47f6-9907-80622646c3ab"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:46.581034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-5b45911a-bc36-4a3e-9a48-5705bffbe710 req-d33015a4-3d3f-40b5-b552-2e8d07663c9f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.581744 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-5b45911a-bc36-4a3e-9a48-5705bffbe710 req-d33015a4-3d3f-40b5-b552-2e8d07663c9f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.590496 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:46.599635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-5b45911a-bc36-4a3e-9a48-5705bffbe710 req-d33015a4-3d3f-40b5-b552-2e8d07663c9f service nova] Creating event network-vif-deleted:2742328d-a56f-47f6-9907-80622646c3ab for instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 on hv-cinder-81242 Jul 28 06:33:46.601337 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-593fefbe-59de-43f4-80a3-7689997eb6b7 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1513 microversion: 2.1 time: 0.418470 Jul 28 06:33:46.613518 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 375/761] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:46 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1513 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:46.613518 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:46.613518 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:46.619614 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-5b45911a-bc36-4a3e-9a48-5705bffbe710 req-d33015a4-3d3f-40b5-b552-2e8d07663c9f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170208 Jul 28 06:33:46.620768 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 387/762] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:46.628300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.628917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.629923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:46.630461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:46.748481 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:46.758906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2371109d-0ee3-4489-a9fc-e01103821b5e tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 200 len: 1330 microversion: 2.1 time: 0.154540 Jul 28 06:33:46.759626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 376/763] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:46 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:47.469377 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:47.470091 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:47.476941 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.477430 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.478217 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.478650 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.514376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.515090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.516414 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lazy-loading 'fault' on Instance uuid c9b09806-4463-4247-ba82-c87e3362cbd4 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:33:47.596922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:47.606605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea90db66-566d-47ef-a06b-a980fe8a6d2a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 200 len: 1325 microversion: 2.1 time: 0.141987 Jul 28 06:33:47.610204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 388/764] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:47 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 1325 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:47.624126 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:47.625341 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:47.633645 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.634477 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.635481 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.636048 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.683494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.684002 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.684455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lazy-loading 'fault' on Instance uuid 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:33:47.727035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97547d56a8684009a794a42ad1c5f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33d1845b3b643b99b066eaeee429e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:47.734830 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f7ef22b6-5fe2-4f99-98c9-12a4270190ab tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 200 len: 1309 microversion: 2.1 time: 0.115157 Jul 28 06:33:47.735414 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 377/765] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:47 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:47.790092 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:47.790918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 028a5ad9-f35d-4c21-b9cb-8f9979d1e113] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:47.801417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.801865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.802653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:47.803052 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:47.819424 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] HTTP exception thrown: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 could not be found. Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Request method failure captured: Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 HTTP/1.1 Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyFZqivNqvdDUS-uLdFM5ziieab-PJrUIzmvCD-ZoZIRHY0SfXjhsvjF9tt_kdGSoem1WjbHFQ-9pMnCRFcH4pkOEMkMxgTJx-G-k-98K_Q3r2U03P_NI14JJAwV3mV-llB9l6nzFnP4Lt_fWfVVhcQZj7mS2MzIq-U6MwSpJLQW6I Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:33:47.820758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cd88554db98441c99e0b09b446c24b47", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}] Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 86a5553819d949ffbc64b7a388942baf Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 could not be found. Jul 28 06:33:47.822364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '028a5ad9-f35d-4c21-b9cb-8f9979d1e113'} Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 could not be found. Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:33:47.823734 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 could not be found. Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 could not be found. Jul 28 06:33:47.825231 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:47.826631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Returning 404 to user: Instance 028a5ad9-f35d-4c21-b9cb-8f9979d1e113 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:33:47.826631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e8ca7076-bf9b-4aa5-8a19-848f027d7113 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113" status: 404 len: 111 microversion: 2.1 time: 0.045757 Jul 28 06:33:47.826631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 389/766] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:47 2022] GET /compute/v2.1/servers/028a5ad9-f35d-4c21-b9cb-8f9979d1e113 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:33:47.832337 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-da1a9d38-8001-4ba0-a992-b250fe39dbe9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '.version_select at 0x7fbe61ae6280>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:47.935669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-da1a9d38-8001-4ba0-a992-b250fe39dbe9 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-332791501" status: 202 len: 0 microversion: 2.1 time: 0.108398 Jul 28 06:33:47.936270 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 378/767] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Jul 28 06:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-332791501 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:33:48.636192 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:48.637034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:48.644920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:48.645513 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:48.646412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:48.646919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:48.656267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-19a3739f-c938-4f64-9951-16d397cae741 req-bb6c4ecf-038f-4912-b7b0-ee3674ce6cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b09806-4463-4247-ba82-c87e3362cbd4", "name": "network-vif-deleted", "tag": "b21bb56c-34cb-4842-9382-4bf8a79421c4"}, {"server_uuid": "53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce", "name": "network-vif-deleted", "tag": "d97de84a-a166-4184-81ca-48cdf759ec0d"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:48.663007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] HTTP exception thrown: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Request method failure captured: Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 HTTP/1.1 Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyP4Xflnc8y-_DQuzZwuu-2bY5ENcaQDkRn7UeAODKHRaI4Nrk0q-Mx0omAlbIyLZjOOpWcDyqOWJmp4FFWBfMYUqHrQ6gfn5k90AsPqQsc8bV2GDEEziSt2UwuzD4lcYg3ds3uo96v_f-VYgRiOujj3FowwRG5DEz16Bt-OxjWREY Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:33:48.664842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f7bae530a50e4c6ea97a654750ddf79f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}] Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 0d268e37c8b64bcc9261a80bb0461edc Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:33:48.667328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'c9b09806-4463-4247-ba82-c87e3362cbd4'} Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:33:48.668756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:33:48.676509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.677606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Returning 404 to user: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:33:48.677606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3d68f08e-83f9-44cf-9ab7-54184e41e84e tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 404 len: 111 microversion: 2.1 time: 0.034033 Jul 28 06:33:48.677606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 390/768] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:48 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:33:48.680456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-19a3739f-c938-4f64-9951-16d397cae741 req-bb6c4ecf-038f-4912-b7b0-ee3674ce6cc8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:48.680974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-19a3739f-c938-4f64-9951-16d397cae741 req-bb6c4ecf-038f-4912-b7b0-ee3674ce6cc8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:48.683440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f45fad38-c5ee-4155-b1f7-5ce7cb43a1d1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '.version_select at 0x7fbe61c2c9d0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:48.694941 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-19a3739f-c938-4f64-9951-16d397cae741 req-bb6c4ecf-038f-4912-b7b0-ee3674ce6cc8 service nova] Creating event network-vif-deleted:b21bb56c-34cb-4842-9382-4bf8a79421c4 for instance c9b09806-4463-4247-ba82-c87e3362cbd4 on hv-cinder-81242 Jul 28 06:33:48.695829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-19a3739f-c938-4f64-9951-16d397cae741 req-bb6c4ecf-038f-4912-b7b0-ee3674ce6cc8 service nova] Creating event network-vif-deleted:d97de84a-a166-4184-81ca-48cdf759ec0d for instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce on hv-cinder-81242 Jul 28 06:33:48.703119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-19a3739f-c938-4f64-9951-16d397cae741 req-bb6c4ecf-038f-4912-b7b0-ee3674ce6cc8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053276 Jul 28 06:33:48.704266 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 379/769] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:48.736003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f45fad38-c5ee-4155-b1f7-5ce7cb43a1d1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134610821" status: 202 len: 0 microversion: 2.1 time: 0.056443 Jul 28 06:33:48.736700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 391/770] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Jul 28 06:33:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134610821 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:33:48.757868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:48.758983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] [instance: 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:48.765908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:48.767476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:48.767476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:48.768200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:48.782071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] HTTP exception thrown: Instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce could not be found. Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Request method failure captured: Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce HTTP/1.1 Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i0lgsE0fjB9q9QSJ2AiQFPK1iugXoau0E1Jkd7hK6dUfHCsb-L-Ph56GTifpJLGSjiPLViNJQoHoxcX03i6CvHddAt6mdnkbF33Tu8M80YBg0ovrWUldVJWFlFDkUEwhC9n9KIktN6c8ptvnFUhKAruy-ceiqju1Ntvyuj7fY9G7iE Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: f33d1845b3b643b99b066eaeee429e12 Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesSnapshotTestJSON-731057165 Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:33:48.783743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f33d1845b3b643b99b066eaeee429e12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f33d1845b3b643b99b066eaeee429e12", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f33d1845b3b643b99b066eaeee429e12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f33d1845b3b643b99b066eaeee429e12"}]}] Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesSnapshotTestJSON-731057165 Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: f33d1845b3b643b99b066eaeee429e12 Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-731057165 Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesSnapshotTestJSON-731057165-project Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 97547d56a8684009a794a42ad1c5f489 Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesSnapshotTestJSON-731057165-project Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce could not be found. Jul 28 06:33:48.785436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': '53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce'} Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce could not be found. Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:33:48.786415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce could not be found. Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce could not be found. Jul 28 06:33:48.787939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:33:48.789705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] Returning 404 to user: Instance 53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:33:48.789705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-318da2bb-5305-490a-9575-7f2074b20d15 tempest-VolumesSnapshotTestJSON-731057165 tempest-VolumesSnapshotTestJSON-731057165-project] 10.222.0.69 "GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce" status: 404 len: 111 microversion: 2.1 time: 0.032065 Jul 28 06:33:48.789705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 380/771] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:48 2022] GET /compute/v2.1/servers/53e5ee5d-2b7f-48c3-a7a6-852a7e0539ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:33:49.571066 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a8d9164e-f1ec-47cf-824f-40f57e895503 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: .version_select at 0x7fbe61b5ce50>, body: {"keypair": {"name": "tempest-keypair-1717568928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSXBMuNo6VOv1ER3ZGo+EKjYIV5K9NfSmTG/9kY/DVje5UPil71mEmhB84kk2HqTS+uoa3RLraRbic7DiBb93tEvZD6DYYIrj+2tdlIr+qe71MlwkdszZ33Zgtz/bITWw=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:49.590331 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-a8d9164e-f1ec-47cf-824f-40f57e895503 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:33:49.595728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-a8d9164e-f1ec-47cf-824f-40f57e895503 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for user 0d268e37c8b64bcc9261a80bb0461edc and project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:33:49.723165 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a8d9164e-f1ec-47cf-824f-40f57e895503 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156024 Jul 28 06:33:49.723918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 392/772] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:33:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:51.268323 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:51.271247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:51.275689 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:51.276143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:51.276909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:51.277394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:51.292730 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:51.303427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:33:51.586108 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4a817a23-0404-41f2-986b-b30c6945ef36 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 204 len: 0 microversion: 2.1 time: 0.322237 Jul 28 06:33:51.589789 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 381/773] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:33:51 2022] DELETE /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:33:51.595598 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:51.596217 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:51.602590 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:51.603043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:51.603826 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:51.604267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:51.817682 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:51.825171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d3a6e425-298d-4e94-99e4-f9ae14b145a2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1507 microversion: 2.1 time: 0.234226 Jul 28 06:33:51.825766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 393/774] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:51 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:52.113848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1440947927", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a12595b-98a5-4f32-a18b-a79716ee46af"}], "security_groups": [{"name": "tempest-securitygroup--1437617193"}], "key_name": "tempest-keypair-1717568928", "user_data": "}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:52.145154 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:52.145759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:52.151888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:52.152331 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:52.153090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:52.153572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:52.178169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7f71d533-83b9-4cf4-996b-d7d81d877691 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/ips" status: 200 len: 151 microversion: 2.1 time: 0.091025 Jul 28 06:33:52.178725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 382/775] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:33:52 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:52.224249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] validate_networks() for [('4a12595b-98a5-4f32-a18b-a79716ee46af', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:33:52.659080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:33:52.659686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:33:52.660267 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:33:52.660752 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:33:52.661241 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:33:52.672549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:52.673001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:52.673971 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:52.674500 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:52.693035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:33:52.702727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Getting quotas for user 0d268e37c8b64bcc9261a80bb0461edc and project f7bae530a50e4c6ea97a654750ddf79f. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:33:52.714632 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:33:52.717146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:33:52.817598 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1c1d1e83-464c-4932-8bdf-9aa4f82ba052 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707853 Jul 28 06:33:52.818168 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 394/776] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:33:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 06:33:52.829106 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0c0afaf1-1150-443b-9e6d-a8673c0e7622 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:52.839754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0c0afaf1-1150-443b-9e6d-a8673c0e7622 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:52.839754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:52.848007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:52.848385 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:52.856983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:52.857842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:52.859854 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:52.860584 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:52.892850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0c0afaf1-1150-443b-9e6d-a8673c0e7622 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:52.900287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0c0afaf1-1150-443b-9e6d-a8673c0e7622 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1238 microversion: 2.1 time: 0.075012 Jul 28 06:33:52.900867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 383/777] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:52 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:53.018218 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:53.026139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c73efa17-2dd4-45c1-90ee-867fd018a026 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1507 microversion: 2.1 time: 0.183485 Jul 28 06:33:53.026728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 395/778] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:52 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:53.922804 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:53.923425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:53.930953 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:53.931404 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:53.932176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:53.932615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:53.999574 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:54.007003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7edc9ca8-8a51-4fa1-9934-5c37ffdb73ca tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1242 microversion: 2.1 time: 0.089233 Jul 28 06:33:54.007575 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 384/779] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:53 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:54.049752 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:54.050377 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:54.057173 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:54.057718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:54.058502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:54.058954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:54.194529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:54.202233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b60414cf-4664-4464-af94-1f8e965bf52c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1507 microversion: 2.1 time: 0.156449 Jul 28 06:33:54.203406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 396/780] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:54 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:54.819864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af4ba1f3-a60b-406e-aa79-c632833adba6"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:54.822277 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:54.828881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:54.829343 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:54.830093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:54.830520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:55.028177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:55.028798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:55.035987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:55.036428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:55.037192 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:55.037646 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:55.110117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:55.117606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6bc2c76e-63e0-4378-8cb4-e302244477a9 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1242 microversion: 2.1 time: 0.093204 Jul 28 06:33:55.118281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 397/781] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:55 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:55.224145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:55.224756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:55.230688 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:55.231205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:55.231972 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:55.232404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:55.381062 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:55.388604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-168dc9ee-6603-4c0e-a456-d469eeee836d tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1507 microversion: 2.1 time: 0.168381 Jul 28 06:33:55.389171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 398/782] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:55 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:56.001741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ab705382-6d7e-4314-9a82-1408c12406e9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.185568 Jul 28 06:33:56.002991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 385/783] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:33:54 2022] POST /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments => generated 194 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:56.138833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:56.139390 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:56.146773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:56.147227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:56.148000 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:56.148441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:56.211949 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:56.219443 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf3296e7-0d21-4528-979a-96554e4e2f6c tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1290 microversion: 2.1 time: 0.084514 Jul 28 06:33:56.220010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 399/784] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:56 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:56.349541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-3712254f-f584-4957-9037-217cbbd8a022 req-18410f73-e9cf-4020-8557-3774bb49a69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cca25c-8de5-474c-894c-13860e7f2146", "name": "network-vif-deleted", "tag": "311a1ab8-32bf-407e-8d50-784a681fe39e"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:56.360498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-3712254f-f584-4957-9037-217cbbd8a022 req-18410f73-e9cf-4020-8557-3774bb49a69a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:56.361211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-3712254f-f584-4957-9037-217cbbd8a022 req-18410f73-e9cf-4020-8557-3774bb49a69a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:56.373890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-3712254f-f584-4957-9037-217cbbd8a022 req-18410f73-e9cf-4020-8557-3774bb49a69a service nova] Creating event network-vif-deleted:311a1ab8-32bf-407e-8d50-784a681fe39e for instance c5cca25c-8de5-474c-894c-13860e7f2146 on hv-cinder-81242 Jul 28 06:33:56.379726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-3712254f-f584-4957-9037-217cbbd8a022 req-18410f73-e9cf-4020-8557-3774bb49a69a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034215 Jul 28 06:33:56.380819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 386/785] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:56.413942 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:56.414620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:56.430704 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:56.431480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:56.432289 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:56.432746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:56.516204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:56.523655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7c1f2289-c8ee-4dba-9299-2d6e4d7e6a2a tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 200 len: 1465 microversion: 2.1 time: 0.115433 Jul 28 06:33:56.524227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 400/786] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:56 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 1465 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:57.241142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:57.241794 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:57.248592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.249040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.249955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.250393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.545819 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:57.546463 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: c5cca25c-8de5-474c-894c-13860e7f2146] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:57.553333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.553808 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.554596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.555039 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.570543 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] HTTP exception thrown: Instance c5cca25c-8de5-474c-894c-13860e7f2146 could not be found. Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Request method failure captured: Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 HTTP/1.1 Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyFZqivNqvdDUS-uLdFM5ziieab-PJrUIzmvCD-ZoZIRHY0SfXjhsvjF9tt_kdGSoem1WjbHFQ-9pMnCRFcH4pkOEMkMxgTJx-G-k-98K_Q3r2U03P_NI14JJAwV3mV-llB9l6nzFnP4Lt_fWfVVhcQZj7mS2MzIq-U6MwSpJLQW6I Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:33:57.572177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cd88554db98441c99e0b09b446c24b47", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}] Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 86a5553819d949ffbc64b7a388942baf Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance c5cca25c-8de5-474c-894c-13860e7f2146 could not be found. Jul 28 06:33:57.574516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'c5cca25c-8de5-474c-894c-13860e7f2146'} Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cca25c-8de5-474c-894c-13860e7f2146 could not be found. Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:33:57.575312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cca25c-8de5-474c-894c-13860e7f2146 could not be found. Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cca25c-8de5-474c-894c-13860e7f2146 could not be found. Jul 28 06:33:57.576534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:33:57.579062 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Returning 404 to user: Instance c5cca25c-8de5-474c-894c-13860e7f2146 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:33:57.579062 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-19c9a9f4-fc90-475d-9303-51fe9b3e89b2 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146" status: 404 len: 111 microversion: 2.1 time: 0.031948 Jul 28 06:33:57.579062 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 401/787] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:57 2022] GET /compute/v2.1/servers/c5cca25c-8de5-474c-894c-13860e7f2146 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:33:57.586454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:57.586454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:57.591234 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.591699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.592492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.593008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.625007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:33:57.716762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:57.724785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-68e42680-b526-4a59-ad9d-a0e0aa3e48a0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.488427 Jul 28 06:33:57.725374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 387/788] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:57 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:57.785513 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:33:57.947281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4ba7d343-9da7-4016-b634-a5de94a54dec tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "DELETE /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 204 len: 0 microversion: 2.1 time: 0.367823 Jul 28 06:33:57.947870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 402/789] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:33:57 2022] DELETE /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:33:57.957440 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:57.959257 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:57.982588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.983162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:57.984185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:57.984624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:58.185040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:58.197990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-419403b6-fd4d-43cf-8bd9-86a2d51c50ae tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.245716 Jul 28 06:33:58.198809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 388/790] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:57 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:33:58.670099 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-0c9adbc7-71eb-4ede-9b53-200954246496 req-e2ca7d4c-410b-4805-97e5-c38ed7d90f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2b54ed-914b-44a9-aea7-9db46c81b1e2", "tag": "fb554a0f-06dd-4144-a372-226de8c86bac"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:33:58.682724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-0c9adbc7-71eb-4ede-9b53-200954246496 req-e2ca7d4c-410b-4805-97e5-c38ed7d90f42 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:58.683380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-0c9adbc7-71eb-4ede-9b53-200954246496 req-e2ca7d4c-410b-4805-97e5-c38ed7d90f42 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:58.696865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-0c9adbc7-71eb-4ede-9b53-200954246496 req-e2ca7d4c-410b-4805-97e5-c38ed7d90f42 service nova] Creating event network-changed:fb554a0f-06dd-4144-a372-226de8c86bac for instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 on hv-cinder-81242 Jul 28 06:33:58.703728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-0c9adbc7-71eb-4ede-9b53-200954246496 req-e2ca7d4c-410b-4805-97e5-c38ed7d90f42 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038033 Jul 28 06:33:58.704585 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 403/791] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:33:58.745955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:58.746785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:58.754715 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:58.755270 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:58.756137 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:58.756651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:58.903071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:58.911235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0be72e7b-5162-4e08-8397-a978b8df8f89 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.169153 Jul 28 06:33:58.911824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 389/792] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:58 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:59.221330 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:59.222045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:59.228924 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:59.229440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:59.230146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:59.230578 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:59.366281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:33:59.374052 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4e36bac9-bb2b-4973-9d90-501d65938582 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.157660 Jul 28 06:33:59.380757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 404/793] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:59 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:33:59.933117 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:33:59.933755 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:33:59.941290 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:59.941768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:33:59.942545 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:33:59.943973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:00.087343 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:00.095634 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c6b0fac9-7e6b-4662-9ecb-886e7a66c7bb tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.166440 Jul 28 06:34:00.096214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 390/794] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:33:59 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:00.395584 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:00.396197 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:00.402940 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:00.403381 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:00.404146 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:00.404606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:00.546205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:00.553791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8023bc95-27d3-4a32-a330-9a54f996d82c tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.162227 Jul 28 06:34:00.554361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 405/795] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:00 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:01.116129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:01.116655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:01.123166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:01.123651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:01.124953 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:01.125421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:01.310036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:01.320171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-543f6ff7-76e9-4496-a7e8-bef42cd53742 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.207898 Jul 28 06:34:01.320756 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 391/796] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:01 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:01.574645 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:01.575244 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:01.582227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:01.582667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:01.583428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:01.583854 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:01.717043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:01.725414 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-49359e6b-b2a8-42f0-88ee-511dbda1161b tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.154569 Jul 28 06:34:01.725992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 406/797] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:01 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:02.342291 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:02.342943 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:02.349626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:02.350137 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:02.350869 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:02.351306 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:02.490842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:02.498274 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-85e8ad46-96a3-41dc-ace6-3c613d84d6e5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.159844 Jul 28 06:34:02.498901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 392/798] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:02 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:02.746990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:02.747602 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:02.750681 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:02.751361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=10 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:02.756262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:02.764465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:02.764465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:02.764465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:02.893450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:02.900801 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c173f231-acc8-4430-ba91-9caeb3b7b968 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.157778 Jul 28 06:34:02.901382 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 407/799] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:02 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:03.519843 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:03.520473 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:03.522503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:03.527864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:03.528302 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:03.533247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:03.533247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:03.705285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:03.713059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-13f5e5fd-53f6-4438-b714-623f53e61df1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.197785 Jul 28 06:34:03.713665 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 393/800] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:03 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:03.921857 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:03.922619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:03.929165 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:03.929625 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:03.930387 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:03.930815 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.241776 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:04.249641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3a66a03a-7628-4d5c-ad18-d28745f1f459 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1521 microversion: 2.1 time: 0.331742 Jul 28 06:34:04.250232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 408/801] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:03 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:04.624080 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af4ba1f3-a60b-406e-aa79-c632833adba6"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:04.629065 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:04.643197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.643197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.643197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.643197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.690517 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-db67df5d-5a65-49a6-aed7-5dac4a09575d req-92165587-60ef-4504-a27a-b9309207135a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304ff8e1-a50f-4e7e-a0df-39476ea30e25", "name": "network-vif-deleted", "tag": "2820efb3-8d20-487d-8462-76666e80919c"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:04.700783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-db67df5d-5a65-49a6-aed7-5dac4a09575d req-92165587-60ef-4504-a27a-b9309207135a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.701221 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-db67df5d-5a65-49a6-aed7-5dac4a09575d req-92165587-60ef-4504-a27a-b9309207135a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.713862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-db67df5d-5a65-49a6-aed7-5dac4a09575d req-92165587-60ef-4504-a27a-b9309207135a service nova] Creating event network-vif-deleted:2820efb3-8d20-487d-8462-76666e80919c for instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 on hv-cinder-81242 Jul 28 06:34:04.720959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-db67df5d-5a65-49a6-aed7-5dac4a09575d req-92165587-60ef-4504-a27a-b9309207135a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034647 Jul 28 06:34:04.721597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 409/802] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:04.736187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:04.736903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:04.742130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Invalid volume: volume af4ba1f3-a60b-406e-aa79-c632833adba6 is already attached to instances: dbf2285f-4557-4371-ada3-e9282cca6137 Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: POST /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments HTTP/1.1 Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 74 Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:34:04.743874 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {"volumeAttachment": {"volumeId": "af4ba1f3-a60b-406e-aa79-c632833adba6"}} Jul 28 06:34:04.745294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Invalid volume: volume af4ba1f3-a60b-406e-aa79-c632833adba6 is already attached to instances: dbf2285f-4557-4371-ada3-e9282cca6137 Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'server_id': 'dbf2285f-4557-4371-ada3-e9282cca6137', 'body': {'volumeAttachment': {'volumeId': 'af4ba1f3-a60b-406e-aa79-c632833adba6'}}} Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af4ba1f3-a60b-406e-aa79-c632833adba6 is already attached to instances: dbf2285f-4557-4371-ada3-e9282cca6137 Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:04.746408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af4ba1f3-a60b-406e-aa79-c632833adba6 is already attached to instances: dbf2285f-4557-4371-ada3-e9282cca6137 Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:04.747718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:34:04.750374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:34:04.750374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:34:04.750374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:34:04.750374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af4ba1f3-a60b-406e-aa79-c632833adba6 is already attached to instances: dbf2285f-4557-4371-ada3-e9282cca6137 Jul 28 06:34:04.750374 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:04.751032 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.751855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 400 to user: Invalid volume: volume af4ba1f3-a60b-406e-aa79-c632833adba6 is already attached to instances: dbf2285f-4557-4371-ada3-e9282cca6137 {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:34:04.752157 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.752297 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bc618b8c-22ff-4c69-839b-f98e21608d60 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125740 Jul 28 06:34:04.752445 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.752445 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.752751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 394/803] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:34:04 2022] POST /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:34:04.817946 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:04.818441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:04.824571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.825021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.825820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:04.826255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:04.893927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:04.903977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8ad99626-f900-4f5f-a8c0-7ebc01707d01 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.171513 Jul 28 06:34:04.904733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 410/804] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:04 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:04.911066 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lazy-loading 'services' on Instance uuid dbf2285f-4557-4371-ada3-e9282cca6137 {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:34:05.185036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-794d717c-fc9f-4896-bd2e-6d1f39200640 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments/af4ba1f3-a60b-406e-aa79-c632833adba6" status: 202 len: 0 microversion: 2.1 time: 0.370991 Jul 28 06:34:05.185662 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 395/805] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:34:04 2022] DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments/af4ba1f3-a60b-406e-aa79-c632833adba6 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:34:05.194204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:05.196296 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:05.203364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:05.203810 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:05.204578 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:05.205038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:05.234328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4aac9cab-3394-458f-877d-b555962f0308 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Jul 28 06:34:05.234876 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 411/806] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:34:05 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:05.273716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:05.273716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:05.279819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:05.280277 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:05.281765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:05.282400 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:05.298976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:05.350194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:05.358436 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9496bb81-a14f-49ed-842e-62e4c83b42ac tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1479 microversion: 2.1 time: 0.090540 Jul 28 06:34:05.359372 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 396/807] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:05 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1479 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:05.930731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:05.931955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:05.942660 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:05.943186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:05.943998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:05.944435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:06.087431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:06.095710 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bf35b958-ca3f-403b-a248-e20f2abb4d29 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.172250 Jul 28 06:34:06.097045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 412/808] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:05 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:06.246828 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:06.249112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:06.256973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:06.259152 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:06.259152 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:06.259152 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:06.288825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5c8460cf-d2a8-433e-8605-0fc2841bb49c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Jul 28 06:34:06.289337 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 397/809] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:34:06 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:06.380104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:06.380912 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:06.387803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:06.392033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:06.392033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:06.392033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:06.426458 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:06.426458 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:06.427075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lazy-loading 'fault' on Instance uuid 304ff8e1-a50f-4e7e-a0df-39476ea30e25 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:34:06.469776 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86a5553819d949ffbc64b7a388942baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd88554db98441c99e0b09b446c24b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:06.477635 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-795bee21-5310-45ec-8b76-8fc52412012f tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 200 len: 1312 microversion: 2.1 time: 0.101596 Jul 28 06:34:06.478248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 413/810] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:06 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:07.116866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:07.117613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:07.125035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.125564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.126336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.126768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.257089 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:07.264590 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6cfbb348-e52f-4d87-99ce-947cb3090863 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.152138 Jul 28 06:34:07.265927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 398/811] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:07 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:07.300664 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:07.302771 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:07.308840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.309286 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.310086 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.310523 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.340998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9d29edda-2c03-4475-b158-c83bd196b06e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044528 Jul 28 06:34:07.341597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 414/812] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:34:07 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:34:07.406899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:07.408625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:07.413721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.414169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.415009 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.415449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.441116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:34:07.500105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:07.500709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] [instance: 304ff8e1-a50f-4e7e-a0df-39476ea30e25] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:07.503216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:07.507976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.508491 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.509283 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.509743 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.523852 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] HTTP exception thrown: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 could not be found. Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Request method failure captured: Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 HTTP/1.1 Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyFZqivNqvdDUS-uLdFM5ziieab-PJrUIzmvCD-ZoZIRHY0SfXjhsvjF9tt_kdGSoem1WjbHFQ-9pMnCRFcH4pkOEMkMxgTJx-G-k-98K_Q3r2U03P_NI14JJAwV3mV-llB9l6nzFnP4Lt_fWfVVhcQZj7mS2MzIq-U6MwSpJLQW6I Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:34:07.525510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_cd88554db98441c99e0b09b446c24b47", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/cd88554db98441c99e0b09b446c24b47"}]}] Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: cd88554db98441c99e0b09b446c24b47 Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1735554614 Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 86a5553819d949ffbc64b7a388942baf Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1735554614-project Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 could not be found. Jul 28 06:34:07.527227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '304ff8e1-a50f-4e7e-a0df-39476ea30e25'} Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 could not be found. Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:34:07.528196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 could not be found. Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 could not be found. Jul 28 06:34:07.529900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:34:07.532047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] Returning 404 to user: Instance 304ff8e1-a50f-4e7e-a0df-39476ea30e25 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:34:07.532047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b508e4a2-d0fd-47c8-91a9-8bc4de14a616 tempest-ServerRescueNegativeTestJSON-1735554614 tempest-ServerRescueNegativeTestJSON-1735554614-project] 10.222.0.69 "GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25" status: 404 len: 111 microversion: 2.1 time: 0.030886 Jul 28 06:34:07.532047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 415/813] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:07 2022] GET /compute/v2.1/servers/304ff8e1-a50f-4e7e-a0df-39476ea30e25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:34:07.711565 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-27a5e03f-e444-4dac-979d-a771f394bb80 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 204 len: 0 microversion: 2.1 time: 0.308516 Jul 28 06:34:07.712165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 399/814] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:34:07 2022] DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:34:07.721068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:07.721832 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:07.728603 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.729134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.730005 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:07.730515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:07.871641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:07.880301 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1190beb7-295e-4d3f-954e-4e157cf6c326 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1682 microversion: 2.1 time: 0.163360 Jul 28 06:34:07.881162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 416/815] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:07 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:08.288216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:08.293050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:08.296722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:08.297174 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:08.298064 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:08.298515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:08.439058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:08.446681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fe981a8e-798b-4766-86d3-24a0d98717ac tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.163256 Jul 28 06:34:08.447303 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 400/816] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:08 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:08.902323 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:08.903236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:08.911248 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:08.911958 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:08.912907 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:08.913564 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:09.064989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:09.072615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-73c6116b-2373-4f33-bc0a-6e6fed5eb318 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1682 microversion: 2.1 time: 0.174148 Jul 28 06:34:09.073271 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 417/817] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:08 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:09.468493 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:09.469107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:09.477769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:09.478210 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:09.482250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:09.482696 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:09.825116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:09.835995 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bbefc87e-bcd3-4722-a946-cd63546b5ba1 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.371479 Jul 28 06:34:09.837261 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 401/818] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:09 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:10.095153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:10.096021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:10.103172 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:10.103955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:10.104799 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:10.105482 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:10.365982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:10.376050 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a3cb1d18-c05d-4653-9dde-e85a024fd983 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1682 microversion: 2.1 time: 0.285691 Jul 28 06:34:10.376984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 418/819] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:10 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:10.857925 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:10.858566 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:10.870848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:10.871256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:10.872519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:10.872519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:11.222944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-511a99c3-f10f-41db-abc1-9931249cc9ea req-d6a3b4c1-dc0e-465d-9e70-ae6fbaffd709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf2285f-4557-4371-ada3-e9282cca6137", "name": "network-vif-deleted", "tag": "d0641c22-d0c9-47a3-afc2-33464fcd85c8"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:11.234424 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-511a99c3-f10f-41db-abc1-9931249cc9ea req-d6a3b4c1-dc0e-465d-9e70-ae6fbaffd709 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:11.235616 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-511a99c3-f10f-41db-abc1-9931249cc9ea req-d6a3b4c1-dc0e-465d-9e70-ae6fbaffd709 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:11.254669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-511a99c3-f10f-41db-abc1-9931249cc9ea req-d6a3b4c1-dc0e-465d-9e70-ae6fbaffd709 service nova] Creating event network-vif-deleted:d0641c22-d0c9-47a3-afc2-33464fcd85c8 for instance dbf2285f-4557-4371-ada3-e9282cca6137 on hv-cinder-81242 Jul 28 06:34:11.260550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-511a99c3-f10f-41db-abc1-9931249cc9ea req-d6a3b4c1-dc0e-465d-9e70-ae6fbaffd709 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041173 Jul 28 06:34:11.262018 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 419/820] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:34:11.331766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:11.339888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-519fd154-00c7-4fe1-b708-a072c76f9bd2 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.485814 Jul 28 06:34:11.341091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 402/821] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:10 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:11.407043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:11.408657 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:11.446438 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:11.448816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:11.451519 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:11.453514 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:11.584702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:11.593104 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bfa26754-2ee8-4ffb-9515-94c3bc85b620 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 200 len: 1326 microversion: 2.1 time: 0.194459 Jul 28 06:34:11.594466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 420/822] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:11 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 1326 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:11.792523 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-c441ea62-7451-45ad-b292-63b017314f8d req-f42ac3b7-2e18-4d96-94f5-c7688de515e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2b54ed-914b-44a9-aea7-9db46c81b1e2", "name": "network-vif-plugged", "status": "completed", "tag": "fb554a0f-06dd-4144-a372-226de8c86bac"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:11.803422 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c441ea62-7451-45ad-b292-63b017314f8d req-f42ac3b7-2e18-4d96-94f5-c7688de515e1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:11.803865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c441ea62-7451-45ad-b292-63b017314f8d req-f42ac3b7-2e18-4d96-94f5-c7688de515e1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:11.815166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-c441ea62-7451-45ad-b292-63b017314f8d req-f42ac3b7-2e18-4d96-94f5-c7688de515e1 service nova] Creating event network-vif-plugged:fb554a0f-06dd-4144-a372-226de8c86bac for instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 on hv-cinder-81242 Jul 28 06:34:11.819967 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-c441ea62-7451-45ad-b292-63b017314f8d req-f42ac3b7-2e18-4d96-94f5-c7688de515e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123104 Jul 28 06:34:11.820576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 403/823] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:12.367251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:12.368319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:12.387669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:12.388129 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:12.388924 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:12.389399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:12.407383 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:12.594466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:12.602110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eb3b85bc-814d-4f74-a92c-74183bd532bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.245169 Jul 28 06:34:12.602690 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 421/824] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:12 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:12.616193 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:12.616917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:12.623320 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:12.623764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:12.624570 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:12.625004 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 HTTP/1.1 Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:34:12.641710 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:34:12.643285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'dbf2285f-4557-4371-ada3-e9282cca6137'} Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:34:12.644024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:34:12.646516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:34:12.647850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:34:12.647850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c225c7ba-e5c5-4601-8f4c-1ff9649dafce tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 404 len: 111 microversion: 2.1 time: 0.031552 Jul 28 06:34:12.651870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-792abb0d-d82c-4d36-a1b6-0fed69e974da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '.version_select at 0x7fbe61b55940>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:12.657032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 404/825] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:12 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:34:12.707493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-792abb0d-d82c-4d36-a1b6-0fed69e974da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598234788" status: 202 len: 0 microversion: 2.1 time: 0.059222 Jul 28 06:34:12.709396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 422/826] 10.222.0.69 () {58 vars in 1218 bytes} [Thu Jul 28 06:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598234788 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:34:13.575200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-57503661-933b-44f1-9c9f-3276bcd68852 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: .version_select at 0x7fbe61ae6160>, body: {"keypair": {"name": "tempest-keypair-1157701218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU3yoD5ywc4kqW6LrXVUqmxXgX9ntN5jl+E8YE4UVV/YxeUqVGKRRs/h1xA0Cm2xkTljweAQyBSQmM6tetOlHenhEZP2B5LJ86jGeckYlUQlazWocY2Eec3asyiHXq+QA=="}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:13.591368 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-57503661-933b-44f1-9c9f-3276bcd68852 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:34:13.595966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-57503661-933b-44f1-9c9f-3276bcd68852 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:34:13.623994 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:13.624730 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:13.631767 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:13.632215 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:13.633017 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:13.633492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:13.667121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-57503661-933b-44f1-9c9f-3276bcd68852 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095742 Jul 28 06:34:13.668189 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 405/827] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:34:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:13.784630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:13.799711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b74de46f-639b-4409-93ea-5b485b2ab5bd tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1364 microversion: 2.1 time: 0.180090 Jul 28 06:34:13.811260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 423/828] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:13 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:14.823028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:14.823797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:14.831338 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:14.831798 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:14.832589 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:14.833034 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:14.967125 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:14.976134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bc29ded6-741a-4638-8287-171b4765820a tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1550 microversion: 2.1 time: 0.157103 Jul 28 06:34:14.989962 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 406/829] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:14 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:14.996797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:14.997429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:15.004987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:15.005476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:15.006277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:15.006764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:15.150351 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8471ccb-f54a-4d1a-a167-c6858c02ee50 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157408 Jul 28 06:34:15.160245 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 424/830] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:34:14 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:15.828401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6a1af8ee-ddf0-4d05-ae59-8428c88533c9 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61ae6040>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:15.892754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6a1af8ee-ddf0-4d05-ae59-8428c88533c9 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/393c02cd-0221-4515-8ec7-e580c2c7d080" status: 200 len: 350 microversion: 2.1 time: 0.067685 Jul 28 06:34:15.893541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 407/831] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:34:15 2022] GET /compute/v2.1/os-volumes/393c02cd-0221-4515-8ec7-e580c2c7d080 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:16.739601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-30ed20ce-46c5-4924-b343-0a08d6333a72 req-9a5ee6ac-8c9d-4e07-8bfd-9e79559d4fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2b54ed-914b-44a9-aea7-9db46c81b1e2", "tag": "fb554a0f-06dd-4144-a372-226de8c86bac"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:16.752988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-30ed20ce-46c5-4924-b343-0a08d6333a72 req-9a5ee6ac-8c9d-4e07-8bfd-9e79559d4fc0 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:16.752988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-30ed20ce-46c5-4924-b343-0a08d6333a72 req-9a5ee6ac-8c9d-4e07-8bfd-9e79559d4fc0 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:16.763988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-30ed20ce-46c5-4924-b343-0a08d6333a72 req-9a5ee6ac-8c9d-4e07-8bfd-9e79559d4fc0 service nova] Creating event network-changed:fb554a0f-06dd-4144-a372-226de8c86bac for instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 on hv-cinder-81242 Jul 28 06:34:16.770139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-30ed20ce-46c5-4924-b343-0a08d6333a72 req-9a5ee6ac-8c9d-4e07-8bfd-9e79559d4fc0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217007 Jul 28 06:34:16.771073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 425/832] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:34:16.924619 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1160375316", "imageRef": "1734f576-8100-4d62-b7d2-c8b5fe950c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbbc8d74-4a13-4069-9d84-f85f9df7bdf6"}], "security_groups": [{"name": "tempest-securitygroup--510670299"}], "key_name": "tempest-keypair-1157701218", "user_data": "}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:17.101191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] validate_networks() for [('fbbc8d74-4a13-4069-9d84-f85f9df7bdf6', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:34:17.715449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-94ff578b-bfd7-4eff-882a-9c6bd4f32261 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61b5c940>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:17.790388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-94ff578b-bfd7-4eff-882a-9c6bd4f32261 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/bf9c21b4-aa20-4073-8f6e-7845adadfa6f" status: 200 len: 351 microversion: 2.1 time: 0.080029 Jul 28 06:34:17.799966 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 426/833] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:34:17 2022] GET /compute/v2.1/os-volumes/bf9c21b4-aa20-4073-8f6e-7845adadfa6f => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:34:18.132807 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:34:18.133661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:34:18.134190 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:34:18.134610 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:34:18.135032 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:34:18.145169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:18.145654 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:18.146464 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:18.146919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:18.167772 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:34:18.172634 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Getting quotas for user 61ad8186d91848bc8be42e3be51e9a75 and project 85bf0de611024c06aee30418f26d2f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:34:18.185291 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:34:18.188195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1734f576-8100-4d62-b7d2-c8b5fe950c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:34:18.320118 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d3a98b1b-daf7-4582-a8f6-a73b9175b047 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.401223 Jul 28 06:34:18.320955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 408/834] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:34:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:34:18.334471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4deeb44e-ef0b-4b3f-8a1d-f57a4f6072cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:18.336102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4deeb44e-ef0b-4b3f-8a1d-f57a4f6072cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:18.393978 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4deeb44e-ef0b-4b3f-8a1d-f57a4f6072cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:18.401687 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4deeb44e-ef0b-4b3f-8a1d-f57a4f6072cb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1242 microversion: 2.1 time: 0.070987 Jul 28 06:34:18.402266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 427/835] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:18 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:19.424647 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:19.425629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:19.437212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:19.437212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:19.437212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:19.437212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:19.505937 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:19.513580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9998f121-899c-4e69-bf31-b707ad52285b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1246 microversion: 2.1 time: 0.094275 Jul 28 06:34:19.520007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 409/836] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:19 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:19.604748 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-18d3e3dc-640e-4349-baf4-1e555225d765 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61b555e0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:19.655493 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-18d3e3dc-640e-4349-baf4-1e555225d765 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/fe6117a4-cada-4812-8179-00156dcf0e47" status: 200 len: 350 microversion: 2.1 time: 0.054426 Jul 28 06:34:19.656450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 428/837] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:34:19 2022] GET /compute/v2.1/os-volumes/fe6117a4-cada-4812-8179-00156dcf0e47 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:19.669060 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-95254e1f-ed5d-4244-a94e-016b82cd5b54 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61abb8b0>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:19.755643 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-95254e1f-ed5d-4244-a94e-016b82cd5b54 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090536 Jul 28 06:34:19.756429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 410/838] 10.222.0.69 () {58 vars in 1134 bytes} [Thu Jul 28 06:34:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:19.772235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-28d5e714-10fb-4efe-8c46-dbecf8e02b44 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61c2caf0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:19.860278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-28d5e714-10fb-4efe-8c46-dbecf8e02b44 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092063 Jul 28 06:34:19.860855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 429/839] 10.222.0.69 () {58 vars in 1149 bytes} [Thu Jul 28 06:34:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:19.875097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-336d0186-bfdf-4858-85a7-000f4faf56d1 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61ae6f70>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:19.963875 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-336d0186-bfdf-4858-85a7-000f4faf56d1 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093066 Jul 28 06:34:19.964542 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 411/840] 10.222.0.69 () {58 vars in 1134 bytes} [Thu Jul 28 06:34:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:19.977003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-adf0bca4-88d7-4dfd-83f9-1ee8e0a2d2fb tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61b18790>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:20.070233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-adf0bca4-88d7-4dfd-83f9-1ee8e0a2d2fb tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088228 Jul 28 06:34:20.070233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 430/841] 10.222.0.69 () {58 vars in 1167 bytes} [Thu Jul 28 06:34:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:20.077057 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ead9c958-ac66-4ad4-a149-48d022ea2a9b tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61d99a60>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:20.163116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ead9c958-ac66-4ad4-a149-48d022ea2a9b tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089861 Jul 28 06:34:20.163861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 412/842] 10.222.0.69 () {58 vars in 1170 bytes} [Thu Jul 28 06:34:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:20.178873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3ef153ac-a3bd-4532-9097-b353de72ed24 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61b181f0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:20.273709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3ef153ac-a3bd-4532-9097-b353de72ed24 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098989 Jul 28 06:34:20.281127 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 431/843] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Jul 28 06:34:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:20.289769 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d5d0344f-0ad2-4b89-9ccb-f8cb8ec49020 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61abb430>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:20.388820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d5d0344f-0ad2-4b89-9ccb-f8cb8ec49020 tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103296 Jul 28 06:34:20.389433 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 413/844] 10.222.0.69 () {58 vars in 1188 bytes} [Thu Jul 28 06:34:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:20.404815 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1807d4dc-6278-4426-8975-b2e8b5937ffa tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] Calling method '.version_select at 0x7fbe61b5cf70>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:20.534721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1807d4dc-6278-4426-8975-b2e8b5937ffa tempest-VolumesTestJSON-1032873541 tempest-VolumesTestJSON-1032873541-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.134846 Jul 28 06:34:20.536846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 432/845] 10.222.0.69 () {58 vars in 1155 bytes} [Thu Jul 28 06:34:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:20.551629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:20.555013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:20.570895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:20.570895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:20.570895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:20.570895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:20.712091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:20.720346 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1f9dfd40-345f-4dd9-bf85-dcc8a264928c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1302 microversion: 2.1 time: 0.188216 Jul 28 06:34:20.720975 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 414/846] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:20 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1302 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:21.746470 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:21.747680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:21.758505 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:21.759223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:21.760432 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:21.760903 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:22.102223 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:22.103770 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:22.115898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:22.115898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:22.115898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:22.115898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:22.154224 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:22.159926 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-79613ad5-fdbf-4b60-a943-01d93c29288c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/ips" status: 200 len: 151 microversion: 2.20 time: 0.063015 Jul 28 06:34:22.161494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 415/847] 10.222.0.69 () {60 vars in 1289 bytes} [Thu Jul 28 06:34:22 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 06:34:22.173559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1722b01c-d1c2-4008-926f-fa6eb2bfbe37 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.433315 Jul 28 06:34:22.174418 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 433/848] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:21 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:22.825401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-556738bb-2721-4b48-921d-608f55ba8dbe req-efae0072-c883-480b-84c7-c75f980e3d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d157d234-2574-4448-be4a-85affdd703ba", "tag": "6aa249fb-e36a-4866-82dd-73c86b5eca39"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:22.860768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-556738bb-2721-4b48-921d-608f55ba8dbe req-efae0072-c883-480b-84c7-c75f980e3d3e service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:22.863578 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-556738bb-2721-4b48-921d-608f55ba8dbe req-efae0072-c883-480b-84c7-c75f980e3d3e service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:22.910287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-556738bb-2721-4b48-921d-608f55ba8dbe req-efae0072-c883-480b-84c7-c75f980e3d3e service nova] Creating event network-changed:6aa249fb-e36a-4866-82dd-73c86b5eca39 for instance d157d234-2574-4448-be4a-85affdd703ba on hv-cinder-81242 Jul 28 06:34:22.928727 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-556738bb-2721-4b48-921d-608f55ba8dbe req-efae0072-c883-480b-84c7-c75f980e3d3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103172 Jul 28 06:34:22.928727 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 416/849] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:23.196041 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:23.197644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:23.204741 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:23.205360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:23.206385 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:23.207033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:23.531138 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:23.540311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-73ab8d62-17a3-4ce9-86a9-5bc15e1ed303 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.348266 Jul 28 06:34:23.542056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 434/850] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:23 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:24.509468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:24.510850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:24.513842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:24.520503 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:24.521267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:24.522930 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:24.527082 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:24.549166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lazy-loading 'flavor' on Instance uuid 6aeac671-ec0f-40ca-850c-51347aa3dee8 {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:34:24.562416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:24.563359 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:24.579524 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:24.579870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:24.580662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:24.581106 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:24.931640 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:24.986608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e67401c4-37dd-4d76-ae31-5d5557d8531e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.428673 Jul 28 06:34:24.991960 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 435/851] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:24 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:25.291408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2cfbb4ee-dbf6-4e98-85ef-30ecc20df704 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/action" status: 202 len: 0 microversion: 2.20 time: 0.774125 Jul 28 06:34:25.294087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 417/852] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Jul 28 06:34:24 2022] POST /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:34:25.307205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:25.308324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:25.316478 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:25.319596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:25.320637 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:25.330361 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:25.593622 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:25.607906 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:25.610657 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:25.625354 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f2532dd5-abe9-4c6d-9bff-0920ca1ec503 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.327581 Jul 28 06:34:25.630591 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 436/853] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:25 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:26.013145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:26.014026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:26.021508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:26.021956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:26.022718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:26.023149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:26.039250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:26.180527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:26.187790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3b5b8db8-793e-4151-8f7a-5680f293dc59 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.179442 Jul 28 06:34:26.188362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 418/854] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:26 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:26.657707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:26.659044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:26.666617 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:26.667061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:26.668016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:26.668460 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:26.903619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:26.914785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:26.922186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:26.926689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7c2f046a-0df5-45e3-aac2-2e23f89ef65a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.273767 Jul 28 06:34:26.927262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 437/855] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:26 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:34:27.208415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:27.209051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:27.216580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:27.217383 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:27.219445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:27.220057 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:27.439065 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:27.454232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f53263ac-5793-492e-9006-d5dd92552622 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.249555 Jul 28 06:34:27.457978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 419/856] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:27 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:27.954718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:27.954718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:27.959953 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:27.960971 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:27.962301 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:27.962945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:28.187307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:28.199116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:28.203875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:28.205434 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2a2f1632-b84a-4fbf-9bf5-1745f78296a2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.257372 Jul 28 06:34:28.206312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 438/857] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:27 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:34:28.483909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:28.485516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:28.489151 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:28.492166 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=10 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:28.507002 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:28.510280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:28.511411 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:28.527389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:28.746054 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:28.758499 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9225a4d2-fa45-4b5c-a249-581f5d585a70 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.279157 Jul 28 06:34:28.772631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 420/858] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:28 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:29.229570 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:29.235662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:29.235662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:29.238405 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-cc62b1e5-4142-4880-8aa3-ea19ce7d58ff req-acf1bfce-4547-436a-96f4-608fe7a92140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d157d234-2574-4448-be4a-85affdd703ba", "name": "network-vif-plugged", "status": "completed", "tag": "6aa249fb-e36a-4866-82dd-73c86b5eca39"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:29.238764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:29.239340 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:29.240116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:29.240644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:29.270109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-cc62b1e5-4142-4880-8aa3-ea19ce7d58ff req-acf1bfce-4547-436a-96f4-608fe7a92140 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:29.271114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-cc62b1e5-4142-4880-8aa3-ea19ce7d58ff req-acf1bfce-4547-436a-96f4-608fe7a92140 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:29.298587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-cc62b1e5-4142-4880-8aa3-ea19ce7d58ff req-acf1bfce-4547-436a-96f4-608fe7a92140 service nova] Creating event network-vif-plugged:6aa249fb-e36a-4866-82dd-73c86b5eca39 for instance d157d234-2574-4448-be4a-85affdd703ba on hv-cinder-81242 Jul 28 06:34:29.304271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-cc62b1e5-4142-4880-8aa3-ea19ce7d58ff req-acf1bfce-4547-436a-96f4-608fe7a92140 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070581 Jul 28 06:34:29.305000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 421/859] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:34:29.723601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:29.735764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:29.741716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:29.749743 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d047aecf-c687-45b5-9e1d-d5dca93f65b5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.517542 Jul 28 06:34:29.749743 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 439/860] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:29 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:29.782569 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:29.783881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:29.828435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:29.830075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:29.850132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:29.858783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:30.146259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:30.154053 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d880c569-0352-477f-8714-99ee03794e5b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.377169 Jul 28 06:34:30.154628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 422/861] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:29 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:30.771079 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:30.771802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:30.783852 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:30.784401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:30.789964 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:30.790677 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:31.038803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:31.050086 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:31.056191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:31.056191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f7efe039-ad80-4148-974c-e5da2e66c2f1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.286394 Jul 28 06:34:31.056191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 440/862] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:30 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:31.179322 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:31.180928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:31.195208 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:31.205954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:31.205954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:31.205954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:31.516251 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:31.526014 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f003f9f0-51f8-4918-a0e5-f9d77831c488 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1367 microversion: 2.1 time: 0.354995 Jul 28 06:34:31.554388 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 423/863] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:31 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:32.076481 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:32.077136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:32.088178 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:32.088630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:32.090648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:32.091825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:32.326707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:32.340004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:32.343177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:32.344735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-814300b6-ef06-4d26-965a-30dcf37f464b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.272388 Jul 28 06:34:32.345489 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 441/864] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:32 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:32.554792 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:32.556073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:32.564691 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:32.565192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:32.566001 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:32.566617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:32.969864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:32.981659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6e4dc9b4-4509-4b23-b0c4-7346544de775 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1558 microversion: 2.1 time: 0.430678 Jul 28 06:34:32.982762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 424/865] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:32 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1558 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:33.003232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:33.003733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:33.011462 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:33.012294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:33.014180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:33.021394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:33.161515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c8f582da-613f-4c45-9b45-2c27e5b163ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162695 Jul 28 06:34:33.162376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 442/866] 10.222.0.69 () {58 vars in 1275 bytes} [Thu Jul 28 06:34:32 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:33.382961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:33.383991 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:33.412825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:33.413820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:33.415827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:33.418169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:33.723895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:33.746901 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:33.749439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:33.751594 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-486361ed-3420-4ee9-8757-108e5f9f6987 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.382737 Jul 28 06:34:33.753286 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 425/867] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:33 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:34.574205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-71a50bcf-030a-4fcd-9453-d9c5a2292cf5 req-296dea25-2779-4e4c-b148-2d1ea17ad51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d157d234-2574-4448-be4a-85affdd703ba", "tag": "6aa249fb-e36a-4866-82dd-73c86b5eca39"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:34.592256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-71a50bcf-030a-4fcd-9453-d9c5a2292cf5 req-296dea25-2779-4e4c-b148-2d1ea17ad51a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:34.593706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-71a50bcf-030a-4fcd-9453-d9c5a2292cf5 req-296dea25-2779-4e4c-b148-2d1ea17ad51a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:34.609907 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-71a50bcf-030a-4fcd-9453-d9c5a2292cf5 req-296dea25-2779-4e4c-b148-2d1ea17ad51a service nova] Creating event network-changed:6aa249fb-e36a-4866-82dd-73c86b5eca39 for instance d157d234-2574-4448-be4a-85affdd703ba on hv-cinder-81242 Jul 28 06:34:34.617506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-71a50bcf-030a-4fcd-9453-d9c5a2292cf5 req-296dea25-2779-4e4c-b148-2d1ea17ad51a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048369 Jul 28 06:34:34.618427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 443/868] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:34.781815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:34.783345 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:34.791081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:34.791864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:34.792866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:34.793869 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:35.096131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:35.110014 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:35.113295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:35.119519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5a485a36-1678-479c-9e9b-3317b1230930 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.343713 Jul 28 06:34:35.120427 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 426/869] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:34 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:36.154312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:36.155854 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:36.163547 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:36.164380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:36.165420 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:36.167237 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:36.423700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:36.453995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:36.453995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:36.456546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-90cf8225-ba1c-49b5-b3a7-d4bfafae0884 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1745 microversion: 2.20 time: 0.310528 Jul 28 06:34:36.457648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 444/870] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:36 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1745 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:37.514435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:37.515178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:37.524278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:37.529928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:37.530954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:37.531583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:37.777839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:37.787418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:37.789850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:37.794352 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a69c0266-1f72-4fbb-b94e-0655bec511b9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1745 microversion: 2.20 time: 0.282792 Jul 28 06:34:37.794352 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 427/871] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:37 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:38.820071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:38.820692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:38.835803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:38.839824 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:38.840299 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:38.841116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:38.847226 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:39.136125 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:39.148202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:39.151550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:39.153067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-426ba356-ed4f-4aaa-9984-f62feb97ec98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.336938 Jul 28 06:34:39.159484 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 445/872] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:38 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:40.181043 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:40.181730 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:40.196547 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:40.197299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:40.198327 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:40.198918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:40.544129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:40.564007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:40.565670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:40.566891 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fd04db41-2c5b-4fe0-9d18-9a9ee62149c5 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.389692 Jul 28 06:34:40.567458 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 428/873] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:40 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:41.112841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-70ca9fce-b34d-4198-a820-f398d3c7b431 req-fe423b09-0dc5-49d6-afde-8643265141a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "name": "network-vif-plugged", "status": "completed", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:41.133757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-70ca9fce-b34d-4198-a820-f398d3c7b431 req-fe423b09-0dc5-49d6-afde-8643265141a3 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:41.136437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-70ca9fce-b34d-4198-a820-f398d3c7b431 req-fe423b09-0dc5-49d6-afde-8643265141a3 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:41.164794 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-70ca9fce-b34d-4198-a820-f398d3c7b431 req-fe423b09-0dc5-49d6-afde-8643265141a3 service nova] Creating event network-vif-plugged:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:34:41.173278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-70ca9fce-b34d-4198-a820-f398d3c7b431 req-fe423b09-0dc5-49d6-afde-8643265141a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063942 Jul 28 06:34:41.178223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 446/874] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:41.597927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:41.599393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:41.611868 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:41.623129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:41.626195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:41.627530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:41.959747 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:41.989752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:41.991606 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:41.992984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d1fe1c28-ded3-469a-be18-a0184cd99ed0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.404806 Jul 28 06:34:41.993794 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 429/875] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:41 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:43.017529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:43.018548 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:43.026502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:43.026954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:43.027995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:43.028450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:43.184119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:43.193908 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:43.195732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:43.196997 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7607f7de-65d5-41bb-a36c-e330f56b08b8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.184299 Jul 28 06:34:43.213716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 447/876] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:43 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:44.220571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:44.221332 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:44.229571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:44.231907 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:44.234490 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:44.235105 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:44.458689 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:44.469110 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:44.471254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:44.472860 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-85eab661-cb5d-46f9-8d4a-f74072a5600d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.256389 Jul 28 06:34:44.474030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 430/877] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:44 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:45.500246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:45.501024 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:45.516976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:45.517806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:45.519026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:45.521174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:45.578986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=96 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:45.756394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:45.766101 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:45.769262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:45.770661 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-487b69de-cd24-4956-9d31-b4640f861be6 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.275902 Jul 28 06:34:45.771712 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 448/878] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:45 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:46.883630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:46.883630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:46.883630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:46.883630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:46.884465 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:46.884465 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:47.002086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:47.011760 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:47.015339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:47.017114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a101f53a-edcb-4d39-bea1-e8db5ec5349e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.226257 Jul 28 06:34:47.017721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 431/879] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:46 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:48.040793 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:48.041426 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:48.049053 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:48.049832 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:48.050780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:48.051217 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:48.192144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:48.200266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:48.202279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:48.203548 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ddf96a76-47ea-4fa3-b163-ed5c934fbe49 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.167096 Jul 28 06:34:48.204140 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 449/880] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:48 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:48.773788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c3773351-a37f-4858-a3d4-ab6f9aac8087 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Action: 'create', calling method: .version_select at 0x7fbe61a7b940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-975705745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/yeEAiX9B8z73mDh7mnixllNYi7RxTZT8R/Hi4yexkqCBoSko6JcbIyS3EbEGcZ/AAZnR/Hp0aG6Sr0WLsRKaUmTe6Kc+UKSyQ/ulNUMR/chZ31pfEJ7w6y1/egZj8wg=="}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:48.794085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-c3773351-a37f-4858-a3d4-ab6f9aac8087 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Getting quotas for project d45f04c2af574b889ee776b6a0fa9d40. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:34:48.799344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-c3773351-a37f-4858-a3d4-ab6f9aac8087 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Getting quotas for user 677cbef82d164fa8bd0a24afc4012cf7 and project d45f04c2af574b889ee776b6a0fa9d40. Resources: {'key_pairs'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:34:48.888976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c3773351-a37f-4858-a3d4-ab6f9aac8087 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.118963 Jul 28 06:34:48.889940 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 432/881] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:34:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:49.031948 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1817680553", "imageRef": "ea5f3595-e780-48bd-8822-78d30916aad3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-975705745", "networks": [{"uuid": "aae82d9d-de2a-4dab-8076-31f8b20f70ef"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:49.098150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] validate_networks() for [('aae82d9d-de2a-4dab-8076-31f8b20f70ef', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:34:49.227858 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:49.229642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:49.241129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:49.241671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:49.242797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:49.243324 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:49.526406 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:49.537377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:49.538998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:49.540309 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8fe23848-ee66-4908-b5b0-5843c7c5b10c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.316464 Jul 28 06:34:49.546545 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 433/882] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:49 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:34:49.649054 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:34:49.649759 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:34:49.650839 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:34:49.651491 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:34:49.651982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:34:49.670604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:49.671324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:49.672229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:49.672778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:49.697628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Getting quotas for project d45f04c2af574b889ee776b6a0fa9d40. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:34:49.702600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Getting quotas for user 677cbef82d164fa8bd0a24afc4012cf7 and project d45f04c2af574b889ee776b6a0fa9d40. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:34:49.720030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:34:49.722851 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ea5f3595-e780-48bd-8822-78d30916aad3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:34:49.886418 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7f81d4b9-4e28-4fb9-b048-22dc17cff6f5 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859412 Jul 28 06:34:49.887854 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 450/883] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:34:49.898907 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-23cd12e2-0c25-4fe1-9001-eb9ae715a533 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:49.900240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-23cd12e2-0c25-4fe1-9001-eb9ae715a533 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:49.979882 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-23cd12e2-0c25-4fe1-9001-eb9ae715a533 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:49.987972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-23cd12e2-0c25-4fe1-9001-eb9ae715a533 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1258 microversion: 2.1 time: 0.092853 Jul 28 06:34:50.003043 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 434/884] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:49 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1258 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:50.570306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:50.571518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:50.580370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:50.581161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:50.582306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:50.583510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:50.757588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:50.767508 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:50.769485 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:50.771141 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-eea09642-b4f9-45e4-a23e-217d436511f8 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.207393 Jul 28 06:34:50.772217 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 451/885] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:50 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:51.009362 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-42b3df69-96e3-4c78-bc53-716d67a187f6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:51.009913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-42b3df69-96e3-4c78-bc53-716d67a187f6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:51.074796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-42b3df69-96e3-4c78-bc53-716d67a187f6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:51.083224 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-42b3df69-96e3-4c78-bc53-716d67a187f6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1258 microversion: 2.1 time: 0.077754 Jul 28 06:34:51.084428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 435/886] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:51 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:51.808615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:51.809251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:51.816008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:51.816459 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:51.817227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:51.817689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:51.967335 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:51.975669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:51.977157 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:51.978528 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ea138cdc-f529-4d45-a447-4c7826cfccba tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.173935 Jul 28 06:34:51.981376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 452/887] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:51 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:52.105706 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:52.106468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:52.114229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:52.114676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:52.115453 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:52.115983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:52.191211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:52.193279 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4459f0c2-3c4d-4e21-92f4-727bcec6d110 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1254 microversion: 2.1 time: 0.091619 Jul 28 06:34:52.193896 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 436/888] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:52 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1254 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:52.964163 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:52.964737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:52.979796 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:52.980302 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:52.981128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:52.981617 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.004993 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:53.005628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:53.013364 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:53.014726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.015791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:53.016826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.023832 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-76f172ed-b0f5-4bb7-b4ac-07cb7ee40a37 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/ips" status: 200 len: 146 microversion: 2.1 time: 0.063497 Jul 28 06:34:53.024434 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 453/889] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:34:52 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:34:53.214764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:53.215636 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:53.224701 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:53.225435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.226476 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:53.226939 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:53.281110 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:53.290086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:53.291760 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:53.294187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3b3eda62-4d78-4742-971b-098ac57530be tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1740 microversion: 2.20 time: 0.295685 Jul 28 06:34:53.294845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 437/890] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:52 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:53.319240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:53.328676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cfc86d84-df2a-44f9-824d-be42139c3ed7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1318 microversion: 2.1 time: 0.117715 Jul 28 06:34:53.329266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 454/891] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:53 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1318 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:54.317847 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:54.319161 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:54.327341 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:54.327908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:54.328903 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:54.329417 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:54.352701 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:54.353718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:54.360676 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:54.361127 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:54.371786 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:54.371786 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:54.837932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:54.841179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:54.845121 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:54.849072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-57211d1b-7bc2-4a72-8839-7cca8c93ee81 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.500948 Jul 28 06:34:54.850210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 455/892] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:54 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:54.852510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:54.854424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:54.855598 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a79a2991-9f86-4d6b-8136-7d046c3fb32e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.541731 Jul 28 06:34:54.856213 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 438/893] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:54 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:34:54.950179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc6e0be7-f33e-4a44-8da0-026ed7241914"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:54.955900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:54.958851 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:54.959292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:54.960316 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:54.960745 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:55.871520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:55.872055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:55.875281 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:55.881325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:55.883480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:55.883480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:55.883480 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:56.078507 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:56.087190 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-73d8b928-2a45-45a6-b768-e05681bf08c0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.219424 Jul 28 06:34:56.101859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 439/894] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:55 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:56.108090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:56.108717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:56.115006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:56.115800 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:56.116580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:56.117019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:56.277091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:56.286505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:56.288085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:56.289260 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-02a1ee34-2d8e-4efd-a20a-cce303c50853 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.186018 Jul 28 06:34:56.290001 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 440/895] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:56 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:57.109441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:57.110196 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:57.117619 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:57.118228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:57.119073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:57.119583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:57.270478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:57.278703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9895e678-eeb9-41e7-99a8-6ee9fda30f2f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.173276 Jul 28 06:34:57.280038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 441/896] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:57 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:57.317835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:57.318391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:57.325011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:57.325506 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:57.326943 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:57.327471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:57.510544 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:57.523346 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:57.527799 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:57.529555 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c2a9d5d7-1c74-4135-841a-f87dae32861e tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.218828 Jul 28 06:34:57.530076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 442/897] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:57 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:34:58.302040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:58.302669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:58.309588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:58.309981 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:58.311676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:58.312342 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:58.568644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:58.577712 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-098f4823-51fe-4cef-8c09-a20bc62585af tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.279886 Jul 28 06:34:58.589960 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 443/898] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:58 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:34:58.598571 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:58.599472 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:58.606526 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:58.607970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:58.608972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:58.609610 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:58.829486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:58.845105 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:58.847127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:58.849742 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3697c3f7-b0ae-4462-863b-abf3ffbe35d1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.257836 Jul 28 06:34:58.863101 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 444/899] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:58 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:34:59.106358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-21702929-3afd-45a9-a3e9-7444d8b12727 req-bc88a002-0fc8-43aa-b573-ef51ed17c34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "name": "network-vif-unplugged", "status": "completed", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:34:59.122431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-21702929-3afd-45a9-a3e9-7444d8b12727 req-bc88a002-0fc8-43aa-b573-ef51ed17c34f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:59.122911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-21702929-3afd-45a9-a3e9-7444d8b12727 req-bc88a002-0fc8-43aa-b573-ef51ed17c34f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:59.137267 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-21702929-3afd-45a9-a3e9-7444d8b12727 req-bc88a002-0fc8-43aa-b573-ef51ed17c34f service nova] Creating event network-vif-unplugged:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:34:59.144036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-21702929-3afd-45a9-a3e9-7444d8b12727 req-bc88a002-0fc8-43aa-b573-ef51ed17c34f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042837 Jul 28 06:34:59.147457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 445/900] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:34:59.618188 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:59.618890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:59.626858 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:59.627617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:59.628416 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:59.628849 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:59.684121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:59.714195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=6 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:34:59.804403 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:34:59.812846 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3609f22b-8766-4f77-8b01-055ed72fd545 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.213702 Jul 28 06:34:59.813765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 446/901] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:34:59 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:34:59.876336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:34:59.876866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:34:59.883085 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:59.883530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:34:59.884423 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:34:59.884863 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:00.032447 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:00.040729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:00.042545 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:00.043723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-46636bfa-67af-4e5d-9a3d-a03f8a0c97a4 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.171597 Jul 28 06:35:00.044282 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 447/902] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:34:59 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:00.293344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:00.294115 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:00.301454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:00.301908 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:00.302698 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:00.303183 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:00.330006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:35:00.653409 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5d88465-63cb-4713-a980-b35ee1c35054 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "DELETE /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 204 len: 0 microversion: 2.1 time: 0.363105 Jul 28 06:35:00.654159 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 448/903] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:00 2022] DELETE /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:35:00.662873 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:00.664211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:00.673504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:00.673504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:00.673504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:00.673504 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:00.979441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:00.988290 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-931b2fec-1db6-4e27-bf12-b7dff520120b tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1578 microversion: 2.1 time: 0.329520 Jul 28 06:35:00.988869 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 449/904] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:00 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1578 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:01.007889 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:01.013132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:01.015692 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:01.016143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:01.016912 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:01.017366 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:01.080738 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=8 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:01.163827 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:01.171792 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-478c8dfa-4ba4-4cc4-821b-589d4584fa95 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.167582 Jul 28 06:35:01.172476 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 450/905] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:00 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:01.177059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:01.177695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:01.195629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:01.196235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:01.197099 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:01.197650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:01.348321 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:01.355390 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:01.356911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:01.358256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3d6b8fe0-f379-4b82-8779-862a2687f351 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.184970 Jul 28 06:35:01.358806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 451/906] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:01 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:02.011036 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:02.011839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:02.020148 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:02.020806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:02.021704 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:02.022533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:02.166900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:02.179617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-38960dd2-5a48-40b3-97be-2c4325033871 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1578 microversion: 2.1 time: 0.168450 Jul 28 06:35:02.179617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 452/907] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:02 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:02.194734 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:02.195347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:02.201445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:02.207196 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:02.207196 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:02.207196 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:02.344845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:02.349560 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0f211f31-2c86-41a0-b09e-1e1a3135c565 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.158630 Jul 28 06:35:02.350129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 453/908] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:02 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:02.382425 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:02.383041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:02.389287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:02.389761 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:02.390583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:02.391180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:02.406576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:02.523848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:02.531691 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:02.533192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:02.534382 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-77982bbc-ca2e-4833-9be6-7eb394b279b2 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.156001 Jul 28 06:35:02.534933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 454/909] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:02 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:03.198150 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:03.198954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:03.206055 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.206499 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.207254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.207685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.439618 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:03.449035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-eff5d49e-67aa-4421-aae0-0f4c31e47c33 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1578 microversion: 2.1 time: 0.254729 Jul 28 06:35:03.449866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 455/910] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:03 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1578 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:03.455096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:03.456198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:03.461917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.462365 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.463128 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.463558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.617233 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:03.625073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b035787f-d89e-4a25-a714-fa9266e343d0 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.174415 Jul 28 06:35:03.630300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 456/911] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:03 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:03.638456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:03.638456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:03.638456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.638456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.639010 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.639449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.807729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:03.817869 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:03.819434 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:03.821011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-86041634-6cdd-4317-a4d2-c3738c06ad0a tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.194212 Jul 28 06:35:03.821603 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 457/912] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:03 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:03.826430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-e3ff4618-ed60-432c-a475-4fb6a6e31f3b req-38c34bb0-8c27-4d10-9132-66bd5a09c846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:03.837502 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-e3ff4618-ed60-432c-a475-4fb6a6e31f3b req-38c34bb0-8c27-4d10-9132-66bd5a09c846 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:03.837951 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-e3ff4618-ed60-432c-a475-4fb6a6e31f3b req-38c34bb0-8c27-4d10-9132-66bd5a09c846 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:03.852343 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-e3ff4618-ed60-432c-a475-4fb6a6e31f3b req-38c34bb0-8c27-4d10-9132-66bd5a09c846 service nova] Creating event network-changed:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:35:03.857775 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-e3ff4618-ed60-432c-a475-4fb6a6e31f3b req-38c34bb0-8c27-4d10-9132-66bd5a09c846 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034955 Jul 28 06:35:03.866118 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 458/913] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:04.474197 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:04.474998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:04.482351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.482805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.483610 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.484049 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.559743 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e8f85539-a671-494e-9a15-7f6047cc36d6 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.613458 Jul 28 06:35:04.580913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 456/914] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:34:54 2022] POST /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments => generated 194 bytes in 9632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:04.646705 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:04.647846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:04.654180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.654800 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.655425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.657477 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.976432 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:04.990248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6d3a1865-b4c8-4b2c-9955-a176e72e4c66 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1578 microversion: 2.1 time: 0.515866 Jul 28 06:35:04.990248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 459/915] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:04 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1578 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:04.990619 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:04.991437 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:04.998090 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:04.998556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:04.999408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:05.000591 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:05.120898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:05.128843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cd42a3a1-e53d-49c4-bdc2-d56167044f15 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.486360 Jul 28 06:35:05.129447 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 457/916] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:04 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:05.557554 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:05.566741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:05.568265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:05.569498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-49e96f9c-98d6-4c8a-bf37-72b37d487afe tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.582696 Jul 28 06:35:05.570048 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 460/917] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:04 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:06.008161 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:06.008888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:06.016362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.016909 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.017721 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.018165 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.096121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:06.103797 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-79c0880b-b7ea-43a0-a0e3-cc72e2ce53cb tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1511 microversion: 2.1 time: 0.099627 Jul 28 06:35:06.104599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 458/918] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:06 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:06.150163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:06.151025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:06.157771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.158226 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.159394 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.160012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.165859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-caf2bee5-c3ad-4c36-96ba-3bcdd12dc25a req-cf1dd707-272b-4e32-8f05-6a5863877c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8c072e-b6c3-486f-9755-c32b99e783f7", "name": "network-vif-deleted", "tag": "e32626bb-30e6-43a9-9be6-672349e56fb4"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:06.175982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-caf2bee5-c3ad-4c36-96ba-3bcdd12dc25a req-cf1dd707-272b-4e32-8f05-6a5863877c8f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.176432 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-caf2bee5-c3ad-4c36-96ba-3bcdd12dc25a req-cf1dd707-272b-4e32-8f05-6a5863877c8f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.187633 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-caf2bee5-c3ad-4c36-96ba-3bcdd12dc25a req-cf1dd707-272b-4e32-8f05-6a5863877c8f service nova] Creating event network-vif-deleted:e32626bb-30e6-43a9-9be6-672349e56fb4 for instance da8c072e-b6c3-486f-9755-c32b99e783f7 on hv-cinder-81242 Jul 28 06:35:06.193085 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-caf2bee5-c3ad-4c36-96ba-3bcdd12dc25a req-cf1dd707-272b-4e32-8f05-6a5863877c8f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Jul 28 06:35:06.194395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 459/919] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:06.307921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:06.316750 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f141adf1-3d08-4bb4-b192-ee3a60de28f2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.170414 Jul 28 06:35:06.317948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 461/920] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:06 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:06.595000 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:06.596002 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:06.603075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.603588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.605089 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:06.606027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:06.786825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:06.794929 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:06.797283 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:06.798588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-43b53f43-277e-47a8-acd9-d04e9456358f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1722 microversion: 2.20 time: 0.210104 Jul 28 06:35:06.802117 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 460/921] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:06 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:07.126531 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:07.127076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:07.133696 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:07.134148 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:07.134921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:07.135357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:07.202966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:07.210932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5c95135b-09ee-4e6f-9a29-199708198fce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1225 microversion: 2.1 time: 0.088982 Jul 28 06:35:07.211506 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 462/922] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:07 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:07.338107 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:07.338718 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:07.346200 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:07.346690 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:07.347505 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:07.347974 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:07.480480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:07.487896 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2e3d4c15-e2a9-4265-9861-d0ae88e80b2b tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.153916 Jul 28 06:35:07.488464 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 461/923] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:07 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:07.823445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:07.824087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:07.830243 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:07.830699 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:07.831475 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:07.831919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:07.970259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:07.978171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:07.979683 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:07.980847 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7207d9b3-5771-4f96-9aef-342f002e036f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1725 microversion: 2.20 time: 0.161423 Jul 28 06:35:07.981438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 463/924] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:07 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:08.006650 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8388d49f-77ba-47f0-a9de-d9cd8883be46"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:08.008166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:08.014239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.014693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.015699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.016150 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.233276 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:08.234681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:08.243451 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.244093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.245062 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.245530 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.279363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.279811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.280268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lazy-loading 'fault' on Instance uuid da8c072e-b6c3-486f-9755-c32b99e783f7 {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:35:08.321740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:08.330313 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-16c87341-5f7e-4e22-b70f-e7d6994eb0b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 200 len: 1230 microversion: 2.1 time: 0.102074 Jul 28 06:35:08.331143 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 464/925] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:08 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:08.508347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:08.508879 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:08.514990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.516340 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.517111 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:08.517572 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:08.652680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:08.660880 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-03dc4c42-8827-4f8c-bf40-38389c22397f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.156483 Jul 28 06:35:08.661505 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 465/926] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:08 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:09.149499 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:09.255809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:09.256961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:09.258618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-731f78cd-6c53-450f-b53d-e308be1b950f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.257331 Jul 28 06:35:09.262355 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 462/927] 10.222.0.69 () {62 vars in 1364 bytes} [Thu Jul 28 06:35:08 2022] POST /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-volume_attachments => generated 188 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 06:35:09.263929 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:09.264387 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:09.265212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:09.265849 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:09.290432 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d3157bb2-2318-4502-8596-3917c1ba54f9 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/ips" status: 200 len: 151 microversion: 2.1 time: 0.038565 Jul 28 06:35:09.291008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 466/928] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:35:09 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:09.356251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:09.357130 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:09.369197 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:09.372794 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:09.373722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:09.374595 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:09.375041 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:09.389271 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] HTTP exception thrown: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Request method failure captured: Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 HTTP/1.1 Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i07fMkJn2JQRQirCm3NfKSmq2P6_roWok4CVt3BSqSF5piAaE9gjVbXoswnlHv3fz9DC4GSd6kb7TreISWD9CAv2O9RrDLLIckcjP9Xor79kTXozdmUZryxjhYUCmcn6RCC96PJ-u4kjLkftfkGN5xLAnvMI5MmMEDCK7QxfiyBM5U Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:09.391265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47b406d9a12c461a84aa0331d2890990", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}] Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestVolumeBootPattern-889618680 Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: b1868c7d0ec8443b9ccb698ee02928b6 Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:35:09.403968 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'da8c072e-b6c3-486f-9755-c32b99e783f7'} Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:09.405136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:35:09.406870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:09.408951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Returning 404 to user: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:09.408951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e116f758-54d0-4bf9-ade6-65fda57c6261 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 404 len: 111 microversion: 2.1 time: 0.040357 Jul 28 06:35:09.408951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 463/929] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:09 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:09.417149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:09.417770 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:09.425997 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:09.435310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:09.435310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:09.435310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:09.528597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1745711748", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-251647084", "security_groups": [{"name": "tempest-secgroup-smoke-546945479"}], "block_device_mapping_v2": [{"uuid": "0128e684-30ad-413e-ac1a-0011a62b0b26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd87854f-57d2-4562-b1ab-837a717d2f52"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:09.649391 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] validate_networks() for [('dd87854f-57d2-4562-b1ab-837a717d2f52', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:35:10.040469 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:35:10.040620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7428c379-ef4d-4984-8c9d-7158fb442978 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-volume_attachments/8388d49f-77ba-47f0-a9de-d9cd8883be46" status: 202 len: 0 microversion: 2.20 time: 0.629991 Jul 28 06:35:10.040931 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:35:10.041403 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 467/930] 10.222.0.69 () {60 vars in 1457 bytes} [Thu Jul 28 06:35:09 2022] DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-volume_attachments/8388d49f-77ba-47f0-a9de-d9cd8883be46 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:35:10.041539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:35:10.041983 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:35:10.042403 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:35:10.046119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:10.046776 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:10.054399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.054709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.055095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.055227 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.055986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.056410 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.056533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.057031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.076135 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for project 47b406d9a12c461a84aa0331d2890990. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:35:10.081562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for user b1868c7d0ec8443b9ccb698ee02928b6 and project 47b406d9a12c461a84aa0331d2890990. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:35:10.159788 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:35:10.161965 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0128e684-30ad-413e-ac1a-0011a62b0b26',volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:35:10.203552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:10.212249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3587086e-153b-4c78-adc4-4644e4db2e17 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.169968 Jul 28 06:35:10.212818 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 468/931] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:10 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:10.217611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:10.218195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:10.224757 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.225200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.226026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.226457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.230311 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:10.256958 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118388) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 06:35:10.662018 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-76c6f7cd-e0c5-434b-93a4-b2c0bd5e198d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "POST /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/action" status: 202 len: 0 microversion: 2.20 time: 0.448035 Jul 28 06:35:10.662743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 469/932] 10.222.0.69 () {62 vars in 1319 bytes} [Thu Jul 28 06:35:10 2022] POST /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:35:10.669258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8bbaeb07-c1f5-4806-a2c8-a097678c105c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.144767 Jul 28 06:35:10.670126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 464/933] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:35:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:35:10.670642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:10.671347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:10.678648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.679224 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.680216 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:10.680906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:10.681331 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d3f401dc-aa31-49d5-8ac0-bbce059eb18a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:10.681964 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d3f401dc-aa31-49d5-8ac0-bbce059eb18a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:10.743692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d3f401dc-aa31-49d5-8ac0-bbce059eb18a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:10.753778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d3f401dc-aa31-49d5-8ac0-bbce059eb18a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1094 microversion: 2.1 time: 0.075847 Jul 28 06:35:10.756736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 465/934] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:10 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:10.863785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:10.871803 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:10.873352 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:10.874630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-654fd2c5-4024-4f0e-8b49-e13caec27ac9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1673 microversion: 2.20 time: 0.207853 Jul 28 06:35:10.875199 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 470/935] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:10 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1673 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:11.021110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddb1e0a4-b3a5-41cd-b122-7ac93bd953d2"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:11.023550 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:11.029665 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.030113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.030882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.031312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.207428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-c4786853-3808-4ebd-b60b-02ad5b29e444 req-58cafd99-2a03-4458-945e-a151b9bcb82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "name": "network-vif-plugged", "status": "completed", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:11.218516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c4786853-3808-4ebd-b60b-02ad5b29e444 req-58cafd99-2a03-4458-945e-a151b9bcb82a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.218966 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c4786853-3808-4ebd-b60b-02ad5b29e444 req-58cafd99-2a03-4458-945e-a151b9bcb82a service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.233970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-c4786853-3808-4ebd-b60b-02ad5b29e444 req-58cafd99-2a03-4458-945e-a151b9bcb82a service nova] Creating event network-vif-plugged:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:35:11.240308 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-c4786853-3808-4ebd-b60b-02ad5b29e444 req-58cafd99-2a03-4458-945e-a151b9bcb82a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036975 Jul 28 06:35:11.241099 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 471/936] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:11.247967 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:11.248865 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:11.257278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.257917 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.258604 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.259212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.491405 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:11.500068 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-67aae5ee-daee-4a85-98e6-0ec3255683d8 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.257075 Jul 28 06:35:11.504346 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 472/937] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:11 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:11.775185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:11.775796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:11.782249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.788805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.788805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.788805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.851119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:11.858606 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f2e61fda-e206-4c44-8d88-1550a160c1f9 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1144 microversion: 2.1 time: 0.087317 Jul 28 06:35:11.859153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 473/938] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:11 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:11.898665 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:11.903448 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:11.909072 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.909629 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.910493 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:11.910997 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:11.955615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e0811f5e-9689-40ba-af56-fb992ba4dfdd tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "POST /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938289 Jul 28 06:35:11.956619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 466/939] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:35:11 2022] POST /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:12.109428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:12.118103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:12.119664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:12.121479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d8b297f3-a4ce-4288-a10c-cb30c88a0749 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1673 microversion: 2.20 time: 0.227273 Jul 28 06:35:12.121999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 474/940] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:11 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:12.522875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:12.523700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:12.530045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:12.530496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:12.531262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:12.531706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:12.674919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:12.685167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0011d85d-9854-4aaa-b581-f7fe76d135c7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1358 microversion: 2.1 time: 0.166891 Jul 28 06:35:12.688061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 467/941] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:12 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:12.879841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:12.880426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:12.886837 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:12.887282 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:12.888038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:12.888477 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:12.951418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:12.959985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-086a664d-c385-4f78-80fb-83c366605778 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1192 microversion: 2.1 time: 0.083813 Jul 28 06:35:12.960553 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 475/942] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:12 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:13.145981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:13.146597 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:13.153141 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.153589 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.154371 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.155007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.215558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:13.218028 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:13.224880 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.226881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.226881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.226881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.258506 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c942c2af-be7f-4fe7-a887-89f7198bf142 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 Jul 28 06:35:13.259093 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 476/943] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:13 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:13.270366 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:13.270854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:13.276984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.277527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.287156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.287156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.294961 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:13.303930 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:13.305467 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:13.306644 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-07d5096c-247c-40a6-a66e-9250bc9f7cc7 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1675 microversion: 2.20 time: 0.165358 Jul 28 06:35:13.307260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 468/944] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:13 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:13.309649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2312c510-1b01-4824-a1c3-36722e6218d5 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/fc6e0be7-f33e-4a44-8da0-026ed7241914" status: 200 len: 194 microversion: 2.1 time: 0.044028 Jul 28 06:35:13.313405 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 477/945] 10.222.0.69 () {58 vars in 1413 bytes} [Thu Jul 28 06:35:13 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/fc6e0be7-f33e-4a44-8da0-026ed7241914 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:13.709853 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:13.710401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:13.718471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.718471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.718658 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.718951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.858732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:13.867380 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0d4da47a-5c88-47dd-acf8-4b63f296859c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1547 microversion: 2.1 time: 0.162395 Jul 28 06:35:13.867961 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 469/946] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:13 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:13.891046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:13.891046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:13.896396 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.896853 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.897659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.898103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.980977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:13.981748 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:13.988223 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.988669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:13.989492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:13.989974 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.041003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.048553 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4d2f4f62-0e5d-43a3-b2b1-0c50d6ede0fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1547 microversion: 2.1 time: 0.164193 Jul 28 06:35:14.049123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 478/947] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:13 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:14.064642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.070037 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:14.073199 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7d3b2249-3a86-4101-a684-721f7a4dff34 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1200 microversion: 2.1 time: 0.096314 Jul 28 06:35:14.073792 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 470/948] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:13 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:14.074990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.075668 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Searching by: {'deleted': False, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40'} {{(pid=118388) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 06:35:14.083617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.084064 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.085175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.085723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.198671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.multi_cell_list [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118388) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 06:35:14.292599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7499a763-3b27-4fe9-b623-0335b7241e74 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227308 Jul 28 06:35:14.293178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 479/949] 10.222.0.69 () {58 vars in 1125 bytes} [Thu Jul 28 06:35:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:14.304545 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:14.305156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:14.311698 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.312141 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.312901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.313559 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.332000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:14.332608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:14.339080 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.339533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.340375 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.340821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.656377 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.659624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.664295 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b6187944-0101-4040-9ce6-efb4a9be75b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1547 microversion: 2.1 time: 0.363555 Jul 28 06:35:14.664905 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 471/950] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:14 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1547 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:14.667854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.669522 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:14.670759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c0b77a00-7359-41b0-8638-9e0afb815012 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.343747 Jul 28 06:35:14.671383 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 480/951] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:14 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:14.934184 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f7d1f47-cddf-472e-86e0-8853461b739b"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:14.936745 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:14.944297 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.944761 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:14.955841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:14.955841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:15.100741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:15.101631 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:15.108074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:15.109140 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:15.109986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:15.110424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:15.244942 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:15.253866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-85ddb718-9c36-4042-849e-7db828ed64b7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1210 microversion: 2.1 time: 0.157500 Jul 28 06:35:15.254740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 481/952] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:15 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:15.694339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:15.694950 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:15.698155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:15.701663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:15.702113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:15.706013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:15.706013 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:15.762174 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-48f2d883-eaae-434d-bcca-63fb5e82c4e0 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "POST /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830543 Jul 28 06:35:15.784715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 472/953] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:35:14 2022] POST /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:15.964270 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:15.975198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:15.977964 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:15.980139 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-232936aa-21e0-4c07-a5e0-dc0a789e3176 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.289913 Jul 28 06:35:15.981133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 482/954] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:15 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:16.283360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:16.284109 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:16.297850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:16.298312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:16.302699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:16.303375 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:16.889613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a2d4992-8f24-41c0-8d2f-6b78f1b2b400"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:16.892418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:16.894473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:16.904709 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:16.905163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:16.907521 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-97e3578f-3704-4f75-80e2-d11a1487603d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.626588 Jul 28 06:35:16.919040 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:16.920870 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:16.921484 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 473/955] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:16 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:17.015545 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:17.016115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:17.032630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:17.033342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:17.034974 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:17.048205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:17.404378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:17.417763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:17.419426 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:17.420655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8a09aa94-a3df-45f4-8d12-303f8845ea8b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.419258 Jul 28 06:35:17.421363 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 474/956] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:16 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:17.664544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-a6067d9b-422b-41a5-acf3-a0c93349ae95 req-9e11f392-43a9-4436-b7ef-c0d72c8c983b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea", "tag": "3fbc8176-5d92-4b04-9641-3e29219cebce"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:17.682794 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-a6067d9b-422b-41a5-acf3-a0c93349ae95 req-9e11f392-43a9-4436-b7ef-c0d72c8c983b service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:17.683511 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-a6067d9b-422b-41a5-acf3-a0c93349ae95 req-9e11f392-43a9-4436-b7ef-c0d72c8c983b service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:17.717423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-a6067d9b-422b-41a5-acf3-a0c93349ae95 req-9e11f392-43a9-4436-b7ef-c0d72c8c983b service nova] Creating event network-changed:3fbc8176-5d92-4b04-9641-3e29219cebce for instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea on hv-cinder-81242 Jul 28 06:35:17.725599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-a6067d9b-422b-41a5-acf3-a0c93349ae95 req-9e11f392-43a9-4436-b7ef-c0d72c8c983b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065788 Jul 28 06:35:17.726843 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 475/957] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:17.938849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:17.940506 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:17.948625 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:17.950022 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:17.950999 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:17.962352 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:17.963524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:18.073511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8d33dae5-bfd9-402c-aa3a-8517fd77b849 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.186002 Jul 28 06:35:18.074715 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 483/958] 10.222.0.69 () {60 vars in 1323 bytes} [Thu Jul 28 06:35:16 2022] POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments => generated 194 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:18.263596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:18.278449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-91d07676-b07f-40fa-a70d-fd5351d40465 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.344564 Jul 28 06:35:18.281650 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 476/959] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:17 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:18.459145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:18.460489 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:18.561543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:18.561543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:18.561543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:18.561543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:18.684149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:18.694455 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:18.696421 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:18.697972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d11fbabb-14e7-4363-ab94-b5ca16f5f5b1 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.245507 Jul 28 06:35:18.699037 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 484/960] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:18 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:19.307007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:19.307865 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:19.316113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:19.316709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:19.317708 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:19.318475 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:19.670326 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:19.678222 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d8c2188d-8a25-4411-9bab-d45b41526344 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.375584 Jul 28 06:35:19.678802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 477/961] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:19 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:19.723777 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:19.725159 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:19.733531 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:19.734333 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:19.736851 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:19.738616 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:19.896133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:19.904650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:19.906180 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:19.907419 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-63757708-d5e2-4cf5-8802-a22f55e59ebf tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.187930 Jul 28 06:35:19.907922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 485/962] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:19 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:20.699701 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:20.700446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:20.702974 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:20.713881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:20.717246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:20.718230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:20.718784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:20.755211 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=8 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:20.884492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:20.892481 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4213560b-b244-4d7c-a2ec-f74d4e8a4f42 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.196658 Jul 28 06:35:20.893955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 478/963] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:20 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:20.935074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:20.935672 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:20.942446 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:20.942900 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:20.943664 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:20.944103 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:21.093155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:21.102367 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:21.104173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:21.105568 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c7835917-f2aa-4070-9b67-099a8d8df882 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.174565 Jul 28 06:35:21.106621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 486/964] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:20 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:21.919374 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:21.920600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:21.931271 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:21.931731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:21.932749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:21.933249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:21.948992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:22.087233 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:22.095423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e555f2e5-2fa6-4b15-8c88-ab3676ad611d tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.183166 Jul 28 06:35:22.107521 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 479/965] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:21 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:22.136207 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:22.136839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:22.145079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:22.145557 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:22.146470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:22.147185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:22.298641 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:22.309961 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:22.311474 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:22.312999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4c5ae123-43e6-484c-b4bc-17fd627c48d0 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.180685 Jul 28 06:35:22.327012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 487/966] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:22 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:23.120036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:23.120739 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:23.128071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:23.128579 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:23.129453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:23.129954 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:23.278487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:23.286641 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ef2772b8-6989-4a77-9c59-948dcb4dd67e tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.170985 Jul 28 06:35:23.287219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 480/967] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:23 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:23.339397 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:23.340015 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:23.347209 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:23.355558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:23.355558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:23.355558 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:23.558391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:23.571439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:23.573021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:23.578693 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6b09689b-45bc-4d6d-800a-e7958003917f tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.243445 Jul 28 06:35:23.586609 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 488/968] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:23 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:24.307655 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:24.308273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:24.314987 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:24.315546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:24.316325 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:24.316764 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:24.453694 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:24.461732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ad23b2e7-d78d-46de-98e6-b734430e3b84 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.157902 Jul 28 06:35:24.462300 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 481/969] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:24 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:24.622383 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:24.622974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:24.625043 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:24.632011 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:24.638122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:24.638122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:24.638122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:24.810486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:24.820235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:24.821907 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:24.823102 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-036377f4-5c0a-4678-b6be-6a7e5661a931 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.204652 Jul 28 06:35:24.823670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 489/970] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:24 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:25.482894 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:25.483510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:25.490178 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:25.490630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:25.491399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:25.491839 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:25.626452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:25.634365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-96eb76e6-afa1-4576-96f6-9c99dd3286a8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.155308 Jul 28 06:35:25.634936 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 482/971] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:25 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:25.846112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:25.846734 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:25.853266 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:25.853738 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:25.854500 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:25.854934 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:25.984525 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:25.992471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:25.994009 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:25.995187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-278a6f43-0495-4497-a13e-3ec4662921dd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.153028 Jul 28 06:35:25.995730 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 490/972] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:25 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:26.655100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:26.655742 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:26.662873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:26.663313 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:26.664073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:26.664510 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:26.806137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:26.813701 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-dc91c882-0bcb-4197-a481-87ddc329ca36 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1277 microversion: 2.1 time: 0.162446 Jul 28 06:35:26.814283 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 483/973] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:26 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:27.020785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:27.021590 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:27.031846 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:27.035527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:27.035527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:27.035527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:27.188509 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:27.198181 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:27.200021 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:27.201633 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5a41831e-6b36-4e63-a246-b9edbf1a951c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.185327 Jul 28 06:35:27.202203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 491/974] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:27 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:27.342809 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:27.343588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:27.353442 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:27.354028 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:27.354950 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:27.355454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:27.446227 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lazy-loading 'services' on Instance uuid d157d234-2574-4448-be4a-85affdd703ba {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:35:27.836181 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:27.836785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:27.843081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:27.843538 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:27.844305 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:27.844740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:27.995809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:28.003584 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4936e0eb-4f45-41f2-988d-712041c544c2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.171636 Jul 28 06:35:28.004156 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 492/975] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:27 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:28.228310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:28.228946 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:28.235686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:28.236140 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:28.237617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:28.238057 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:28.374556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:28.384601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:28.386074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:28.387283 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d394bcae-648c-4ebb-bdfd-f8f58040f9aa tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.164767 Jul 28 06:35:28.387849 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 493/976] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:28 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:35:28.544496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b1c4868d-fc5f-43d3-b6d0-3773af56e7a5 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments/ddb1e0a4-b3a5-41cd-b122-7ac93bd953d2" status: 202 len: 0 microversion: 2.1 time: 1.205416 Jul 28 06:35:28.545905 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 484/977] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:35:27 2022] DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments/ddb1e0a4-b3a5-41cd-b122-7ac93bd953d2 => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:35:28.554204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:28.556533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:28.562726 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:28.565512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:28.565512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:28.565512 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:28.597113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-8fa735dd-9f70-4d8a-9406-2c9302300483 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047148 Jul 28 06:35:28.599589 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 494/978] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:28 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:29.026133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:29.026920 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:29.033236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.033839 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.034627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.035068 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.171987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-f3b37cda-9855-40c2-a5f0-272a91238d26 req-601ad800-fe98-4ac8-8771-e1cc48c639a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "name": "network-vif-plugged", "status": "completed", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:29.185530 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:29.185866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-f3b37cda-9855-40c2-a5f0-272a91238d26 req-601ad800-fe98-4ac8-8771-e1cc48c639a3 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.185866 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-f3b37cda-9855-40c2-a5f0-272a91238d26 req-601ad800-fe98-4ac8-8771-e1cc48c639a3 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.186190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-85a8c5d0-ff9e-40f7-bb74-e7c5dceb9377 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.163735 Jul 28 06:35:29.186190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 485/979] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:29 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:29.197171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-f3b37cda-9855-40c2-a5f0-272a91238d26 req-601ad800-fe98-4ac8-8771-e1cc48c639a3 service nova] Creating event network-vif-plugged:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:35:29.202847 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-f3b37cda-9855-40c2-a5f0-272a91238d26 req-601ad800-fe98-4ac8-8771-e1cc48c639a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034550 Jul 28 06:35:29.203471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 495/980] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:29.411755 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:29.412583 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:29.419527 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.420162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.421007 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.421604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.593925 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:29.603013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:29.604530 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:29.605741 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-014e9504-dc76-4d54-85da-3a9c6f0a9f16 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.199365 Jul 28 06:35:29.616685 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 486/981] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:29 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:29.617058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:29.617058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:29.620286 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.620766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.621562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:29.621996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:29.650876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6e2830c3-d9e8-4519-ba40-7356c513b2bb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 Jul 28 06:35:29.651428 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 496/982] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:29 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:30.211595 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:30.212207 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:30.218715 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:30.219165 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:30.219927 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:30.220364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:30.365353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:30.373021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4ba96513-6e14-4ef1-8781-8eb385cde6a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.165569 Jul 28 06:35:30.373621 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 487/983] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:30 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:30.629859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:30.630490 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:30.637058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:30.637531 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:30.638291 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:30.638721 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:30.663285 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:30.665589 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:30.671684 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:30.672143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:30.672922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:30.673386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:30.705606 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a990f9f0-a072-4ebb-8b51-ad57a83db51d tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Jul 28 06:35:30.706371 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 488/984] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:30 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:30.773074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:30.782128 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:30.783702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:30.784956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d826dc40-8a58-49d6-80ec-5a4326955798 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.159542 Jul 28 06:35:30.785543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 497/985] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:30 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:31.395005 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:31.396384 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:31.404847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:31.405292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:31.409428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:31.409428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:31.544918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:31.553473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c9547d14-16f1-4800-8774-798478bf3efe tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.162934 Jul 28 06:35:31.555186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 489/986] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:31 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:31.718311 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:31.720857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:31.728222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:31.728672 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:31.729470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:31.729932 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:31.760079 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-56b598cc-fbbd-4779-a1ea-f52e883a6cc4 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045667 Jul 28 06:35:31.760655 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 498/987] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:31 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:31.808971 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:31.810154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:31.821096 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:31.821870 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:31.822671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:31.823115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:31.955631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:31.964166 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:31.965730 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:31.966916 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1dced2db-d723-4bc7-9eba-937c3c13a854 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1731 microversion: 2.20 time: 0.162727 Jul 28 06:35:31.967447 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 490/988] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:31 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:32.574689 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:32.575294 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:32.582393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:32.582839 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:32.583592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:32.584275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:32.718106 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:32.726078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b63f1c11-9555-4cbd-b83a-9abbbf9c0a41 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.155224 Jul 28 06:35:32.726687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 499/989] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:32 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:32.772768 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:32.775078 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:32.781604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:32.782055 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:32.782825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:32.783264 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:32.814347 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b1e5af65-e5fb-4635-8f0e-9b3e91cafa36 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046155 Jul 28 06:35:32.815022 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 491/990] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:32 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:32.991198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:32.991717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:32.997715 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:32.998167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:32.998923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:32.999358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:33.139334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:33.147230 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:33.148723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:33.149911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f3c5e58e-dcc7-44dd-bec8-990c27f9e8f9 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1718 microversion: 2.20 time: 0.163289 Jul 28 06:35:33.150462 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 500/991] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:35:32 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:35:33.747365 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:33.748341 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:33.754837 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:33.755288 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:33.756051 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:33.756509 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:33.827200 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:33.829724 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:33.845074 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:33.845561 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:33.846350 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:33.847491 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:33.852448 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=100 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:33.879041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f2d290b5-a6ae-4b91-a184-21078bdc8acb tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055784 Jul 28 06:35:33.879628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 501/992] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:33 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:33.891263 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:33.898830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-275e40d8-18c2-42b6-83f9-6e4abba0e7fc tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.155261 Jul 28 06:35:33.899406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 492/993] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:33 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:34.892817 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:34.895008 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:34.902144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:34.905268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:34.905268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:34.905268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:34.920406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:34.921030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:34.928229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:34.928678 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:34.929542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:34.929993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:34.939132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-904dbf81-1b6e-4391-9274-68fa46c2d22c tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050875 Jul 28 06:35:34.939766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 502/994] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:34 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:35.070826 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:35.079784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6e2cb3aa-18a9-4b3c-ba9f-d0ad38abe1a5 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.163287 Jul 28 06:35:35.080362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 493/995] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:34 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:35.742391 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:35.744115 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:35.750380 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.750831 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.751649 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.752128 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.784771 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3e3dae5b-5b67-428f-bd69-a1c176591418 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046355 Jul 28 06:35:35.785389 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 503/996] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:35 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:35.925630 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:35.926203 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:35.933601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.934001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.934782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.935225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.951759 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:35.957487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:35.961498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.961948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.962725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.963165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.965516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-683b6589-c6ee-4de7-b1b0-ccd6c1938349 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/fc6e0be7-f33e-4a44-8da0-026ed7241914" status: 200 len: 194 microversion: 2.1 time: 0.044621 Jul 28 06:35:35.966270 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 494/997] 10.222.0.69 () {58 vars in 1413 bytes} [Thu Jul 28 06:35:35 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/fc6e0be7-f33e-4a44-8da0-026ed7241914 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:35.976156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:35.976643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:35.982544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.982986 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.983726 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:35.984156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:35.993876 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-51851785-1973-4223-884c-313c90a405e8 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Jul 28 06:35:35.997544 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 504/998] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:35 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:35.999487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:36.066840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lazy-loading 'services' on Instance uuid dc2b54ed-914b-44a9-aea7-9db46c81b1e2 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:35:36.102557 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:36.103165 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:36.109381 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:36.109836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:36.110607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:36.111076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:36.245780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:36.253466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0135c683-1d75-4bd3-95c9-57c89fa8f150 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.154794 Jul 28 06:35:36.254037 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 505/999] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:36 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:36.286893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4f46baf6-ac52-40ca-92a2-508abd506653 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/fc6e0be7-f33e-4a44-8da0-026ed7241914" status: 202 len: 0 microversion: 2.1 time: 0.314362 Jul 28 06:35:36.287486 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 495/1000] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:35:35 2022] DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/fc6e0be7-f33e-4a44-8da0-026ed7241914 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:35:37.007947 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:37.010105 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:37.016732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:37.017178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:37.017974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:37.018527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:37.047854 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dd9e3d52-0e1b-475a-b33f-32a3703950da tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Jul 28 06:35:37.048418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 506/1001] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:37 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:37.274947 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:37.275673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:37.282446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:37.282887 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:37.286992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:37.286992 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:37.303061 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-88d2ed4a-2389-4c94-a8b1-85d09794fb17 req-4fe43d01-69ba-473e-9c7a-03fb03b7c44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea", "name": "network-vif-plugged", "status": "completed", "tag": "3fbc8176-5d92-4b04-9641-3e29219cebce"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:37.312642 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-88d2ed4a-2389-4c94-a8b1-85d09794fb17 req-4fe43d01-69ba-473e-9c7a-03fb03b7c44e service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:37.313206 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-88d2ed4a-2389-4c94-a8b1-85d09794fb17 req-4fe43d01-69ba-473e-9c7a-03fb03b7c44e service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:37.324717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-88d2ed4a-2389-4c94-a8b1-85d09794fb17 req-4fe43d01-69ba-473e-9c7a-03fb03b7c44e service nova] Creating event network-vif-plugged:3fbc8176-5d92-4b04-9641-3e29219cebce for instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea on hv-cinder-81242 Jul 28 06:35:37.329958 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-88d2ed4a-2389-4c94-a8b1-85d09794fb17 req-4fe43d01-69ba-473e-9c7a-03fb03b7c44e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030487 Jul 28 06:35:37.331365 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 507/1002] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:37.440461 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:37.448074 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3f08f4f7-9773-4277-ab28-a1fdf3fafdb2 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.177845 Jul 28 06:35:37.448640 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 496/1003] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:37 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:38.061740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:38.064022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:38.071003 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:38.071454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:38.072226 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:38.072663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:38.101620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5dd8e92-3321-48bc-9819-6cf3d7ec5a6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Jul 28 06:35:38.102176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 508/1004] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:38 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:38.469737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:38.470346 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:38.477648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:38.478119 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:38.478940 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:38.479386 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:38.610149 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:38.618703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-80d65064-30c7-4578-be9e-e62728fb0e59 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1265 microversion: 2.1 time: 0.152762 Jul 28 06:35:38.619206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 497/1005] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:38 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:39.113848 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:39.115998 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:39.122527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:39.122977 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:39.123744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:39.124179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:39.156912 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-db78cbf7-9a55-4b58-be5d-1ee3f6af8f14 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Jul 28 06:35:39.163722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 509/1006] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:39 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:39.639280 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:39.639827 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:39.646551 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:39.647008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:39.647784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:39.648226 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:39.784848 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:39.792428 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6a18e510-7ada-4cc1-9ed6-8bf0fb50d5d7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1452 microversion: 2.1 time: 0.157098 Jul 28 06:35:39.793004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 498/1007] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:39 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:39.812914 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:39.813575 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:39.820345 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:39.820796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:39.821591 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:39.822031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:39.963612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:39.971050 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ab758e4b-41c2-4c13-8dfc-d360d1f48528 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1452 microversion: 2.1 time: 0.161973 Jul 28 06:35:39.972173 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 510/1008] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:39 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:40.175145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:40.177458 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:40.179434 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:40.184334 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:40.184780 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:40.185576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:40.186013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:40.216803 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fc351c8c-f4cc-415f-bcef-a0a7d099b2ee tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046367 Jul 28 06:35:40.217397 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 499/1009] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:40 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:41.229252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:41.231779 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:41.239390 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:41.239936 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:41.240800 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:41.241240 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:41.273523 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cea1ec59-4a83-4b80-ac1b-56868c37b9ed tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Jul 28 06:35:41.274099 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 511/1010] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:41 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:42.169923 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-7afad79d-113b-4fce-a463-9f812bc5e7c6 req-d1f5cf62-4453-443c-ae8c-f0f6b74cb645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea", "tag": "3fbc8176-5d92-4b04-9641-3e29219cebce"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:42.180875 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-7afad79d-113b-4fce-a463-9f812bc5e7c6 req-d1f5cf62-4453-443c-ae8c-f0f6b74cb645 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:42.181258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-7afad79d-113b-4fce-a463-9f812bc5e7c6 req-d1f5cf62-4453-443c-ae8c-f0f6b74cb645 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:42.193566 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-7afad79d-113b-4fce-a463-9f812bc5e7c6 req-d1f5cf62-4453-443c-ae8c-f0f6b74cb645 service nova] Creating event network-changed:3fbc8176-5d92-4b04-9641-3e29219cebce for instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea on hv-cinder-81242 Jul 28 06:35:42.198753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-7afad79d-113b-4fce-a463-9f812bc5e7c6 req-d1f5cf62-4453-443c-ae8c-f0f6b74cb645 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Jul 28 06:35:42.199308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 500/1011] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:42.286686 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:42.288963 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:42.295577 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:42.296044 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:42.296804 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:42.297723 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:42.333339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fe762fcf-6828-4e6f-b293-00f301aff4d1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050822 Jul 28 06:35:42.334456 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 512/1012] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:42 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:43.259238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:43.259238 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:43.259859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:43.259967 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:43.261553 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:43.262214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:43.347937 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:43.350724 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:43.357776 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:43.358217 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:43.358992 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:43.359463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:43.393713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-6bb45324-1152-4fe0-80ba-b2ba5154afb0 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050152 Jul 28 06:35:43.394255 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 513/1013] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:43 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:43.413405 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:43.422202 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d775a095-02c0-4aac-95d4-50793c1434fe tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1593 microversion: 2.1 time: 0.176597 Jul 28 06:35:43.423072 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 501/1014] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:43 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1593 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:44.405546 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:44.407768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:44.415131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.415579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.416358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.416793 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.449888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9140792d-f76d-414b-a69e-2f18f5ed4052 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048318 Jul 28 06:35:44.450836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 514/1015] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:44 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:35:44.513006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:44.513623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:44.520671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.521147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.521990 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.522388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.551281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:35:44.823005 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:44.824762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:44.829540 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.830001 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.830819 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.831261 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.841046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8b14f9c5-b20e-4e82-8290-46e2967be661 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 204 len: 0 microversion: 2.1 time: 0.331673 Jul 28 06:35:44.841674 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 502/1016] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:44 2022] DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:35:44.850187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:44.850890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:44.856799 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.857251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.858067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.858533 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.860843 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-be25ff8f-3d90-4b37-be28-2241c1898faf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/6f7d1f47-cddf-472e-86e0-8853461b739b" status: 200 len: 194 microversion: 2.1 time: 0.042010 Jul 28 06:35:44.861670 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 515/1017] 10.222.0.69 () {58 vars in 1413 bytes} [Thu Jul 28 06:35:44 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/6f7d1f47-cddf-472e-86e0-8853461b739b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:35:44.872547 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:44.877109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:44.879796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.880250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.881052 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:44.881542 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:44.976017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lazy-loading 'services' on Instance uuid dc2b54ed-914b-44a9-aea7-9db46c81b1e2 {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:35:45.003205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:45.011249 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6b6be9b0-0f21-4641-a753-4b3fa1586a43 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1683 microversion: 2.1 time: 0.165137 Jul 28 06:35:45.018834 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 503/1018] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:44 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:35:45.212461 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-7297927b-c246-4cbb-b0c3-f27880887825 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/6f7d1f47-cddf-472e-86e0-8853461b739b" status: 202 len: 0 microversion: 2.1 time: 0.343586 Jul 28 06:35:45.213064 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 516/1019] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:35:44 2022] DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments/6f7d1f47-cddf-472e-86e0-8853461b739b => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:35:45.582587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-8489d97d-e0a6-4b04-a0a2-466b10fada5e req-211ac598-1a5f-40f3-8a67-4169e610adac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:45.593993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8489d97d-e0a6-4b04-a0a2-466b10fada5e req-211ac598-1a5f-40f3-8a67-4169e610adac service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:45.594829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-8489d97d-e0a6-4b04-a0a2-466b10fada5e req-211ac598-1a5f-40f3-8a67-4169e610adac service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:45.607063 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-8489d97d-e0a6-4b04-a0a2-466b10fada5e req-211ac598-1a5f-40f3-8a67-4169e610adac service nova] Creating event network-changed:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:35:45.612746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-8489d97d-e0a6-4b04-a0a2-466b10fada5e req-211ac598-1a5f-40f3-8a67-4169e610adac service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033562 Jul 28 06:35:45.613397 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 504/1020] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:46.036539 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:46.037385 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:46.039281 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=69 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:46.044420 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:46.044861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:46.045834 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:46.046986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:46.205116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:46.209282 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:46.213632 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-40e9da29-23e8-4cc7-8a9d-6e852a84fe01 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1683 microversion: 2.1 time: 0.183228 Jul 28 06:35:46.214215 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 517/1021] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:46 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:47.239270 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:47.242433 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:47.251180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:47.252002 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:47.254450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:47.255093 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:47.579993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:47.588975 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-402d6cd4-6233-408c-9df7-f60149f5ae6b tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1683 microversion: 2.1 time: 0.356687 Jul 28 06:35:47.589636 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 505/1022] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:47 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1683 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:48.028429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1868824558"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:48.028969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:48.037856 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.038243 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.039022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.039463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.281824 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.network.security_group_api [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Adding security group 2af970f6-abe0-4f63-a6b4-2db1e10f5343 to port 1180a354-41d4-4d24-8328-e75871937ec8 Jul 28 06:35:48.285683 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-5af03cfb-8fb0-4401-952f-65357c5f5734 req-f05159c6-d70f-457a-af2e-4cd476c04af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d157d234-2574-4448-be4a-85affdd703ba", "name": "network-vif-deleted", "tag": "6aa249fb-e36a-4866-82dd-73c86b5eca39"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:48.302784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-5af03cfb-8fb0-4401-952f-65357c5f5734 req-f05159c6-d70f-457a-af2e-4cd476c04af2 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.305520 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-5af03cfb-8fb0-4401-952f-65357c5f5734 req-f05159c6-d70f-457a-af2e-4cd476c04af2 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.319350 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-5af03cfb-8fb0-4401-952f-65357c5f5734 req-f05159c6-d70f-457a-af2e-4cd476c04af2 service nova] Creating event network-vif-deleted:6aa249fb-e36a-4866-82dd-73c86b5eca39 for instance d157d234-2574-4448-be4a-85affdd703ba on hv-cinder-81242 Jul 28 06:35:48.325801 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-5af03cfb-8fb0-4401-952f-65357c5f5734 req-f05159c6-d70f-457a-af2e-4cd476c04af2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052939 Jul 28 06:35:48.328099 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 506/1023] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:48.585073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:48.590829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:48.603049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.603049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.605228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.605228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.646426 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bac3a5a8-3f58-477e-ae89-3e955da32043 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070437 Jul 28 06:35:48.647017 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 507/1024] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:48 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 06:35:48.657601 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:48.660421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:48.667525 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.668281 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.669392 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.670475 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.709716 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.710396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.711738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lazy-loading 'fault' on Instance uuid d157d234-2574-4448-be4a-85affdd703ba {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:35:48.764605 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ad8186d91848bc8be42e3be51e9a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85bf0de611024c06aee30418f26d2f1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:48.790204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cf5b7a23-53cc-4850-9b66-42bd9023f230 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/action" status: 202 len: 0 microversion: 2.1 time: 0.765915 Jul 28 06:35:48.792086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 518/1025] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:35:48 2022] POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:35:48.792930 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c47619da-38d9-45d2-8159-8b1f513e5bf2 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 200 len: 1332 microversion: 2.1 time: 0.143723 Jul 28 06:35:48.794016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 508/1026] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:48 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 1332 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:48.812859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:48.813177 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:48.813964 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:48.815206 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:48.825503 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.826580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.827344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.827629 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.843851 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.845007 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.846919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.847857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.895288 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4145eb27-77f2-4794-9011-4814ff2f001b tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091569 Jul 28 06:35:48.896396 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 519/1027] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:35:48 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:35:48.984146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:48.984665 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:48.998045 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:48.998758 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:48.999823 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:49.000644 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:49.021287 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:49.031755 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-156d2908-9cef-4b4a-8335-9beabe2ffd03 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1759 microversion: 2.1 time: 0.228955 Jul 28 06:35:49.032187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:35:49.032662 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 509/1028] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:48 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1759 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:49.464669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f220a7b1-5239-4881-bcde-b42e0433cd9f tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 204 len: 0 microversion: 2.1 time: 0.487033 Jul 28 06:35:49.466243 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 520/1029] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:48 2022] DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:35:49.475373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:49.475982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:49.482738 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:49.483194 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:49.488075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:49.488075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:49.631906 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:49.643760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3d4d6900-24de-4060-bd05-a5536cdc7ffa tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1675 microversion: 2.1 time: 0.170097 Jul 28 06:35:49.645522 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 510/1030] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:49 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:49.817355 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:49.818059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:49.824198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:49.824877 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:49.825701 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:49.826131 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:49.841615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba HTTP/1.1 Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:35:49.843280 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:49.844956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'd157d234-2574-4448-be4a-85affdd703ba'} Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:49.845931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:49.847786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:49.849985 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:49.851037 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-1522f123-bcc5-40ff-8a33-5c7cf63a7361 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 404 len: 111 microversion: 2.1 time: 0.038813 Jul 28 06:35:49.851613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 521/1031] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:49 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:49.860224 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-493dd5c4-0528-4568-b011-76b61c0ed4b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '.version_select at 0x7fbe61c9ed30>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:49.954881 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-493dd5c4-0528-4568-b011-76b61c0ed4b1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157701218" status: 202 len: 0 microversion: 2.1 time: 0.098269 Jul 28 06:35:49.956260 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 511/1032] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Jul 28 06:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157701218 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:35:50.357363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-d4c7e650-9e2f-4a0d-93e8-be9e94eff1fb req-e61d39dc-0959-49eb-8b80-357ace23d12b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:50.368620 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d4c7e650-9e2f-4a0d-93e8-be9e94eff1fb req-e61d39dc-0959-49eb-8b80-357ace23d12b service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:50.369034 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-d4c7e650-9e2f-4a0d-93e8-be9e94eff1fb req-e61d39dc-0959-49eb-8b80-357ace23d12b service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:50.382567 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-d4c7e650-9e2f-4a0d-93e8-be9e94eff1fb req-e61d39dc-0959-49eb-8b80-357ace23d12b service nova] Creating event network-changed:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:35:50.387791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-d4c7e650-9e2f-4a0d-93e8-be9e94eff1fb req-e61d39dc-0959-49eb-8b80-357ace23d12b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034380 Jul 28 06:35:50.389001 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 522/1033] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:50.663955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:50.664785 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:50.671620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:50.672344 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:50.673145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:50.678037 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:50.694757 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:35:50.833102 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:50.842388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5f16f0fe-4b51-4e0d-972e-dd9fa4dc3bd8 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1675 microversion: 2.1 time: 0.183511 Jul 28 06:35:50.843199 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 512/1034] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:50 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:51.865038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:51.865780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:51.872430 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:51.872850 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:51.873638 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:51.874067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:51.994004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:51.994568 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:52.001925 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.002446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.003324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.003762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.018842 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba HTTP/1.1 Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:52.020537 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.022095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'd157d234-2574-4448-be4a-85affdd703ba'} Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:52.022849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.024185 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.026333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:52.026333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e57f9b4f-b167-4ce2-a4ee-1f016f1bb124 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 404 len: 111 microversion: 2.1 time: 0.031892 Jul 28 06:35:52.026333 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 513/1035] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:51 2022] DELETE /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:35:52.031484 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:52.032143 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: d157d234-2574-4448-be4a-85affdd703ba] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:52.039171 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.040255 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.040406 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.040820 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.055525 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba HTTP/1.1 Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:52.057137 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.058944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'd157d234-2574-4448-be4a-85affdd703ba'} Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:52.059860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. Jul 28 06:35:52.061370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:52.062711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance d157d234-2574-4448-be4a-85affdd703ba could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:52.062711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c7b15abd-e0dc-4628-8dd2-b644c7e409ef tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba" status: 404 len: 111 microversion: 2.1 time: 0.030967 Jul 28 06:35:52.062711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 514/1036] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:52 2022] GET /compute/v2.1/servers/d157d234-2574-4448-be4a-85affdd703ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:52.220591 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:52.228717 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-33a07e15-31ad-47e6-9560-a60338301408 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1675 microversion: 2.1 time: 0.368374 Jul 28 06:35:52.229298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 523/1037] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:51 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1675 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:52.554772 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:52.556982 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:52.563029 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.563472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.564246 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.564714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.792769 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4a2d6f37-b84b-49f6-acb2-f4c3c3dca959 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/action" status: 202 len: 0 microversion: 2.1 time: 0.241733 Jul 28 06:35:52.802841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:52.803651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:52.806700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 515/1038] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:35:52 2022] POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:35:52.810171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.815344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.815344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.815344 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.929707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-6e7bc2f1-1dee-43b7-a6f4-33423e734fa5 req-44daae0a-2063-41e2-b399-99f872ea3530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2b54ed-914b-44a9-aea7-9db46c81b1e2", "name": "network-vif-deleted", "tag": "fb554a0f-06dd-4144-a372-226de8c86bac"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:35:52.945487 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6e7bc2f1-1dee-43b7-a6f4-33423e734fa5 req-44daae0a-2063-41e2-b399-99f872ea3530 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:52.945947 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-6e7bc2f1-1dee-43b7-a6f4-33423e734fa5 req-44daae0a-2063-41e2-b399-99f872ea3530 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:52.965200 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-6e7bc2f1-1dee-43b7-a6f4-33423e734fa5 req-44daae0a-2063-41e2-b399-99f872ea3530 service nova] Creating event network-vif-deleted:fb554a0f-06dd-4144-a372-226de8c86bac for instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 on hv-cinder-81242 Jul 28 06:35:52.972363 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-6e7bc2f1-1dee-43b7-a6f4-33423e734fa5 req-44daae0a-2063-41e2-b399-99f872ea3530 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046454 Jul 28 06:35:52.973514 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 516/1039] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:35:53.123407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:53.137766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dedbb2e4-9b96-4203-a11e-b6bacb1e53f4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1751 microversion: 2.1 time: 0.339097 Jul 28 06:35:53.138486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 524/1040] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:52 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1751 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:53.251956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:53.251956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:53.259421 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.259871 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.260877 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.261329 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.295607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.296315 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.296770 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lazy-loading 'fault' on Instance uuid dc2b54ed-914b-44a9-aea7-9db46c81b1e2 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:35:53.371206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d268e37c8b64bcc9261a80bb0461edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bae530a50e4c6ea97a654750ddf79f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:53.381579 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d4ab78fa-c613-49e9-9403-766b3cb14404 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 200 len: 1328 microversion: 2.1 time: 0.135863 Jul 28 06:35:53.391533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:53.392410 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:53.396118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 517/1041] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:53 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 1328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:53.399167 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.399621 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.402399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.402399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.415599 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 HTTP/1.1 Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:35:53.417334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.418944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'dbf2285f-4557-4371-ada3-e9282cca6137'} Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:53.419895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.421429 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.422898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:53.422898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dcf57d17-fa28-4bb8-9de2-75d9ecbd64f6 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 404 len: 111 microversion: 2.1 time: 0.031141 Jul 28 06:35:53.422898 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 525/1042] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:53 2022] DELETE /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:53.427666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:53.428411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: dbf2285f-4557-4371-ada3-e9282cca6137] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:53.434499 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.437808 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.437808 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.437808 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.450709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 HTTP/1.1 Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:53.452362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.454049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'dbf2285f-4557-4371-ada3-e9282cca6137'} Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:53.454847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. Jul 28 06:35:53.456667 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.457830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance dbf2285f-4557-4371-ada3-e9282cca6137 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:53.457830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9803445b-dcdb-45e7-b434-54c894826138 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137" status: 404 len: 111 microversion: 2.1 time: 0.030233 Jul 28 06:35:53.457830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 518/1043] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:53 2022] GET /compute/v2.1/servers/dbf2285f-4557-4371-ada3-e9282cca6137 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:53.463289 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:53.466719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:53.470198 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.470716 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.471705 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.472275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.486254 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: DELETE /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b HTTP/1.1 Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:35:53.487820 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.489435 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'f3658bb5-2010-4828-b904-d276f960e32b'} Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:53.490265 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.491785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.493218 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:53.493218 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-06fdd7b4-2aca-43e3-baf1-11360cef2ec1 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 404 len: 111 microversion: 2.1 time: 0.029888 Jul 28 06:35:53.493218 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 526/1044] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:53 2022] DELETE /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:53.497778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:53.498396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: f3658bb5-2010-4828-b904-d276f960e32b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:53.505446 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.505891 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.506666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:53.507103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:53.521599 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b HTTP/1.1 Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:53.523139 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.524859 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'f3658bb5-2010-4828-b904-d276f960e32b'} Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:53.525783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. Jul 28 06:35:53.527214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:53.528784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance f3658bb5-2010-4828-b904-d276f960e32b could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:53.528784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-483ccbf8-d5c9-4879-b817-3656b3fdae8e tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b" status: 404 len: 111 microversion: 2.1 time: 0.030638 Jul 28 06:35:53.528784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 519/1045] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:53 2022] GET /compute/v2.1/servers/f3658bb5-2010-4828-b904-d276f960e32b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:54.161108 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:54.161741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:54.167990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.168437 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.169201 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.169687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.321339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:54.329354 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-057ea419-db18-444e-828a-1ff6ba7fa586 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.173218 Jul 28 06:35:54.337418 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 527/1046] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:54 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:54.403728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:54.405436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:54.411696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.412148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.412928 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.413396 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.427850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] HTTP exception thrown: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Request method failure captured: Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 HTTP/1.1 Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyP4Xflnc8y-_DQuzZwuu-2bY5ENcaQDkRn7UeAODKHRaI4Nrk0q-Mx0omAlbIyLZjOOpWcDyqOWJmp4FFWBfMYUqHrQ6gfn5k90AsPqQsc8bV2GDEEziSt2UwuzD4lcYg3ds3uo96v_f-VYgRiOujj3FowwRG5DEz16Bt-OxjWREY Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:54.429451 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f7bae530a50e4c6ea97a654750ddf79f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}] Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 0d268e37c8b64bcc9261a80bb0461edc Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:54.431148 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'dc2b54ed-914b-44a9-aea7-9db46c81b1e2'} Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:54.432031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:54.433539 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.434749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Returning 404 to user: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:54.434749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-b33d0e26-020d-4770-ab7f-8c5bd9c8dc83 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 404 len: 111 microversion: 2.1 time: 0.031058 Jul 28 06:35:54.434749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 520/1047] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:54 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:54.441041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b02d3299-dcff-4fa3-a7c4-c5d290465bde tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '.version_select at 0x7fbe61c39790>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:54.522223 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b02d3299-dcff-4fa3-a7c4-c5d290465bde tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717568928" status: 202 len: 0 microversion: 2.1 time: 0.085008 Jul 28 06:35:54.522811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 528/1048] 10.222.0.69 () {58 vars in 1221 bytes} [Thu Jul 28 06:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717568928 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 06:35:54.838475 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:54.839037 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:54.845416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.846035 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.847479 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.848240 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.862163 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa HTTP/1.1 Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:54.863680 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.865010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'b394488f-cd75-46c4-b399-909d7bd808fa'} Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:54.865806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.867058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.868308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:54.868308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9f7ca62f-c30e-4960-b364-4ce3b14311ac tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 404 len: 111 microversion: 2.1 time: 0.031564 Jul 28 06:35:54.868308 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 521/1049] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:54 2022] DELETE /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:54.874791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:54.875397 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] [instance: b394488f-cd75-46c4-b399-909d7bd808fa] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:54.881624 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.882070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.882838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:54.883271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:54.897491 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] HTTP exception thrown: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Request method failure captured: Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa HTTP/1.1 Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyJUUPKXxA_SSlzqsM1AcrHYElwk_9qqXb552sDXEbY0dB7cAnrDxDJPl3SU689N_-A_yOPEDSZsrEmefKdzeRLV7mwckaNiUZ9e0T94teGiC0I0NcOcWh1PkFep4jxzt9bEJKStU3GM0RJqtl84VKWiBelk8-fG19j8appxWdjNjE Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:35:54.899026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_85bf0de611024c06aee30418f26d2f1c", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/85bf0de611024c06aee30418f26d2f1c"}]}] Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 85bf0de611024c06aee30418f26d2f1c Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-390604292 Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 61ad8186d91848bc8be42e3be51e9a75 Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeNegativeTest-390604292-project Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.900359 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'b394488f-cd75-46c4-b399-909d7bd808fa'} Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:54.901142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. Jul 28 06:35:54.902780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:54.904284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] Returning 404 to user: Instance b394488f-cd75-46c4-b399-909d7bd808fa could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:54.904284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9b97f986-1c67-486c-b9c1-e49f592a9506 tempest-AttachVolumeNegativeTest-390604292 tempest-AttachVolumeNegativeTest-390604292-project] 10.222.0.69 "GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jul 28 06:35:54.904284 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 529/1050] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:54 2022] GET /compute/v2.1/servers/b394488f-cd75-46c4-b399-909d7bd808fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:55.353441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:55.354278 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:55.362015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:55.362576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:55.363441 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:55.363956 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:55.518423 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:55.527363 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7ea3b7d4-5c22-4444-9f69-4910c0d37dd3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.177854 Jul 28 06:35:55.528049 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 522/1051] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:55 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:56.549899 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:56.550524 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:56.557271 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:56.557752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:56.558525 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:56.558962 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:56.703754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:56.712754 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2b8efdc4-469d-4165-a1fa-ea40d2c57fba tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.166753 Jul 28 06:35:56.713341 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 530/1052] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:56 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:57.734404 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:57.735733 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:57.744703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:57.745215 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:57.746101 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:57.746707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:57.995997 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:58.006422 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f7506449-d1ee-40a7-bc6d-23eaf7ede8b2 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.275851 Jul 28 06:35:58.007167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 523/1053] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:57 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:58.079401 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:58.079888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:58.087087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:58.087651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:58.088647 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:58.089329 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:58.103763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] HTTP exception thrown: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Request method failure captured: Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 HTTP/1.1 Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyP4Xflnc8y-_DQuzZwuu-2bY5ENcaQDkRn7UeAODKHRaI4Nrk0q-Mx0omAlbIyLZjOOpWcDyqOWJmp4FFWBfMYUqHrQ6gfn5k90AsPqQsc8bV2GDEEziSt2UwuzD4lcYg3ds3uo96v_f-VYgRiOujj3FowwRG5DEz16Bt-OxjWREY Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:35:58.105548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f7bae530a50e4c6ea97a654750ddf79f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}] Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 0d268e37c8b64bcc9261a80bb0461edc Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.107171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'dc2b54ed-914b-44a9-aea7-9db46c81b1e2'} Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:58.108888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.113395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.114648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Returning 404 to user: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:58.114648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-824f66bc-a1b9-4ef9-864a-2945c2922554 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 404 len: 111 microversion: 2.1 time: 0.031872 Jul 28 06:35:58.114648 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 531/1054] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:58 2022] DELETE /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:58.126988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:58.127688 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: dc2b54ed-914b-44a9-aea7-9db46c81b1e2] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:58.139360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:58.139816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:58.140609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:58.147860 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:58.158687 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] HTTP exception thrown: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Request method failure captured: Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 HTTP/1.1 Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyP4Xflnc8y-_DQuzZwuu-2bY5ENcaQDkRn7UeAODKHRaI4Nrk0q-Mx0omAlbIyLZjOOpWcDyqOWJmp4FFWBfMYUqHrQ6gfn5k90AsPqQsc8bV2GDEEziSt2UwuzD4lcYg3ds3uo96v_f-VYgRiOujj3FowwRG5DEz16Bt-OxjWREY Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:58.160969 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f7bae530a50e4c6ea97a654750ddf79f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}] Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 0d268e37c8b64bcc9261a80bb0461edc Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.162557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'dc2b54ed-914b-44a9-aea7-9db46c81b1e2'} Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:58.163452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. Jul 28 06:35:58.165030 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:58.166353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Returning 404 to user: Instance dc2b54ed-914b-44a9-aea7-9db46c81b1e2 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:58.166353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-40a5da96-7bbc-420e-b802-d8e231da4e43 tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2" status: 404 len: 111 microversion: 2.1 time: 0.050297 Jul 28 06:35:58.166353 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 524/1055] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:58 2022] GET /compute/v2.1/servers/dc2b54ed-914b-44a9-aea7-9db46c81b1e2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:59.029802 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:59.030415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:59.036994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:59.037471 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:59.038247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:59.038836 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:59.239089 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:35:59.247172 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f5726ceb-97ab-4ca3-93a4-415852662f71 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.221135 Jul 28 06:35:59.247740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 532/1056] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:59 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:35:59.469442 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:59.469949 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:59.476689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:59.477144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:59.478075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:59.479320 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:59.494431 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] HTTP exception thrown: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Request method failure captured: Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 HTTP/1.1 Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyP4Xflnc8y-_DQuzZwuu-2bY5ENcaQDkRn7UeAODKHRaI4Nrk0q-Mx0omAlbIyLZjOOpWcDyqOWJmp4FFWBfMYUqHrQ6gfn5k90AsPqQsc8bV2GDEEziSt2UwuzD4lcYg3ds3uo96v_f-VYgRiOujj3FowwRG5DEz16Bt-OxjWREY Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:35:59.496021 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f7bae530a50e4c6ea97a654750ddf79f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}] Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 0d268e37c8b64bcc9261a80bb0461edc Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.497699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'c9b09806-4463-4247-ba82-c87e3362cbd4'} Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:59.498736 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.500266 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.502008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Returning 404 to user: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:59.502008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fe94c62e-13f0-4571-9cf6-88882bbbe7bf tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 404 len: 111 microversion: 2.1 time: 0.032405 Jul 28 06:35:59.502008 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 525/1057] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:35:59 2022] DELETE /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:35:59.508370 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:35:59.509202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] [instance: c9b09806-4463-4247-ba82-c87e3362cbd4] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:35:59.515612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:59.516516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:59.517719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:35:59.518986 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:35:59.534214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] HTTP exception thrown: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Request method failure captured: Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 HTTP/1.1 Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyP4Xflnc8y-_DQuzZwuu-2bY5ENcaQDkRn7UeAODKHRaI4Nrk0q-Mx0omAlbIyLZjOOpWcDyqOWJmp4FFWBfMYUqHrQ6gfn5k90AsPqQsc8bV2GDEEziSt2UwuzD4lcYg3ds3uo96v_f-VYgRiOujj3FowwRG5DEz16Bt-OxjWREY Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:35:59.535988 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f7bae530a50e4c6ea97a654750ddf79f", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f7bae530a50e4c6ea97a654750ddf79f"}]}] Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: f7bae530a50e4c6ea97a654750ddf79f Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeTestJSON-666533946 Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 0d268e37c8b64bcc9261a80bb0461edc Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeTestJSON-666533946-project Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.537379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'c9b09806-4463-4247-ba82-c87e3362cbd4'} Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:35:59.538310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. Jul 28 06:35:59.539763 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:35:59.543416 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] Returning 404 to user: Instance c9b09806-4463-4247-ba82-c87e3362cbd4 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:35:59.543815 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2276d483-912a-4526-ade5-0a9dbd3c807d tempest-AttachVolumeTestJSON-666533946 tempest-AttachVolumeTestJSON-666533946-project] 10.222.0.69 "GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4" status: 404 len: 111 microversion: 2.1 time: 0.039808 Jul 28 06:35:59.551312 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 533/1058] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:35:59 2022] GET /compute/v2.1/servers/c9b09806-4463-4247-ba82-c87e3362cbd4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:36:00.269618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:00.270235 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:00.276458 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:00.276902 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:00.277702 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:00.278133 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:00.781561 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:00.790147 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-12a42fdf-4870-45a8-b40c-f21c964ae4b7 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.524765 Jul 28 06:36:00.790807 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 526/1059] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:00 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:00.989188 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-31d298cf-e5c3-427d-a5bb-507efade72cb tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Action: 'create', calling method: .version_select at 0x7fbe61cd9820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-608539718"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:36:01.679786 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-31d298cf-e5c3-427d-a5bb-507efade72cb tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.806819 Jul 28 06:36:01.680424 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 534/1060] 10.222.0.69 () {60 vars in 1155 bytes} [Thu Jul 28 06:36:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 808 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 06:36:01.693642 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-63463d8a-43ba-464f-96b8-d37f81a97e60 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe625de9d0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:01.751496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-63463d8a-43ba-464f-96b8-d37f81a97e60 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 200 len: 344 microversion: 2.1 time: 0.060581 Jul 28 06:36:01.752084 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 527/1061] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:01 2022] GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:01.812114 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:01.813024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:01.827583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:01.828886 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:01.829814 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:01.832706 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:02.061557 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:02.070765 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2ec8c529-d770-4be3-ba60-7046fe427c5a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.262428 Jul 28 06:36:02.085148 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 535/1062] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:01 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:02.766332 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f80f6360-5af5-4fac-ad85-f94845ebd4e0 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d3c790>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:02.813849 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f80f6360-5af5-4fac-ad85-f94845ebd4e0 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 200 len: 345 microversion: 2.1 time: 0.051881 Jul 28 06:36:02.814417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 528/1063] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:02 2022] GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:02.827534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fe6073a6-ca2b-490f-b764-8c9df66a62bd tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Action: 'create', calling method: .version_select at 0x7fbe61a5f040>, body: {"snapshot": {"volume_id": "a854a963-503d-410d-ad7b-f08f29589453", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1029374416"}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:36:03.093225 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:03.094373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:03.103966 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:03.104769 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:03.105596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:03.106042 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:03.294029 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:03.306407 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1d765db4-b632-4c78-9a3f-32c3fc180a41 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.217426 Jul 28 06:36:03.320695 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 529/1064] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:03 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:36:03.321116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fe6073a6-ca2b-490f-b764-8c9df66a62bd tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.487960 Jul 28 06:36:03.321116 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 536/1065] 10.222.0.69 () {60 vars in 1162 bytes} [Thu Jul 28 06:36:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:36:03.323634 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-69da17da-a946-4114-a6ba-3caf75c1035e tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe625deee0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:03.375027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-69da17da-a946-4114-a6ba-3caf75c1035e tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 287 microversion: 2.1 time: 0.051380 Jul 28 06:36:03.375027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 530/1066] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:03 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:03.383026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d85bf66e-fe25-4f08-ba8a-ed531c50d461 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61b74310>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:03.417091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d85bf66e-fe25-4f08-ba8a-ed531c50d461 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038450 Jul 28 06:36:03.417618 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 537/1067] 10.222.0.69 () {58 vars in 1140 bytes} [Thu Jul 28 06:36:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:03.429038 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5ba42a15-58f1-4294-b47e-2b92b0d381b9 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d3c790>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:03.461890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5ba42a15-58f1-4294-b47e-2b92b0d381b9 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 287 microversion: 2.1 time: 0.037180 Jul 28 06:36:03.462799 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 531/1068] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:03 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:04.328781 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:04.329468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:04.336902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:04.337379 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:04.341981 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:04.342445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:04.475009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-223b232f-e69c-418b-9e2b-8d5af6a12853 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61cf7e50>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:04.492356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:04.500550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f4315dc4-d9b2-488d-8e17-299e89932929 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.176245 Jul 28 06:36:04.501081 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 538/1069] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:04 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:36:04.507449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-223b232f-e69c-418b-9e2b-8d5af6a12853 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 287 microversion: 2.1 time: 0.036773 Jul 28 06:36:04.508015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 532/1070] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:04 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:05.520562 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e0111ada-a749-4364-86e8-53ea23b4590a tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61c87670>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:05.523419 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:05.524036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:05.532389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:05.532389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:05.532389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:05.532389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:05.555194 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e0111ada-a749-4364-86e8-53ea23b4590a tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 287 microversion: 2.1 time: 0.039049 Jul 28 06:36:05.555954 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 539/1071] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:05 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:05.686354 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:05.695163 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-24402427-6541-4981-b501-f54fcea3bb9d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.176618 Jul 28 06:36:05.695742 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 533/1072] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:05 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:36:06.569125 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0475d90a-69f1-4b08-8545-bf0b2a5bdbd6 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61a5f9d0>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:06.598724 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0475d90a-69f1-4b08-8545-bf0b2a5bdbd6 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 287 microversion: 2.1 time: 0.034971 Jul 28 06:36:06.603921 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 540/1073] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:06 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:06.717516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:06.718135 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:06.724836 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:06.725291 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:06.726190 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:06.726632 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:06.796222 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:06.799431 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:06.805564 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:06.806022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:06.806802 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:06.807239 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:06.840356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d3d75df7-e455-45fd-96c5-8594b12e87bc tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047956 Jul 28 06:36:06.840945 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 541/1074] 10.222.0.69 () {60 vars in 1343 bytes} [Thu Jul 28 06:36:06 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:36:06.891985 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:06.900776 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ade26f79-d57f-4245-b490-9f6439465ed4 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.187143 Jul 28 06:36:06.901489 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 534/1075] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:06 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:06.918258 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:06.918749 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:06.925764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:06.926204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:06.926959 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:06.927393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:06.960292 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:36:06.995880 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:07.178163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d95152e1-e3bf-4da3-adf3-d20cc92ce88d tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 204 len: 0 microversion: 2.20 time: 0.263484 Jul 28 06:36:07.178751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 542/1076] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Jul 28 06:36:06 2022] DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 06:36:07.186771 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:07.189399 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:07.193608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:07.194061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:07.194890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:07.195325 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:07.336970 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:07.344989 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:07.346628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:07.348315 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-90a8a412-467b-47e3-ba31-11eaa8572999 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.165364 Jul 28 06:36:07.348884 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 535/1077] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:36:07 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:36:07.614324 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dbbafac6-9643-4142-9536-c6c07114b708 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61cd9550>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:07.647236 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dbbafac6-9643-4142-9536-c6c07114b708 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 288 microversion: 2.1 time: 0.039250 Jul 28 06:36:07.647811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 543/1078] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:07 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:07.658918 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3272ca4d-44bf-48a3-8fe9-5ceaa19c6391 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61b55af0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:07.778851 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3272ca4d-44bf-48a3-8fe9-5ceaa19c6391 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 202 len: 0 microversion: 2.1 time: 0.123736 Jul 28 06:36:07.779430 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 536/1079] 10.222.0.69 () {58 vars in 1254 bytes} [Thu Jul 28 06:36:07 2022] DELETE /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:36:07.788574 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0f6127b8-75cb-4e12-aff6-0839422ecc07 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d0f700>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:07.826244 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0f6127b8-75cb-4e12-aff6-0839422ecc07 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 200 len: 287 microversion: 2.1 time: 0.042303 Jul 28 06:36:07.826826 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 544/1080] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:07 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:07.923221 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:07.923839 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:07.930722 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:07.931176 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:07.931980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:07.932488 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:08.090919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:08.099437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-09e4c4e5-7d3b-4e4c-bae7-dc724dcd97a3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.180404 Jul 28 06:36:08.100253 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 537/1081] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:07 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:36:08.371855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:08.372589 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:08.380371 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:08.380915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:08.382487 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:08.382984 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:08.525469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:08.533997 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:08.535583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:08.536744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-67d106de-d657-4966-8805-e29d0a4a1504 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1724 microversion: 2.20 time: 0.168800 Jul 28 06:36:08.537300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 545/1082] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:36:08 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 06:36:08.839120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a48fc56-5f3d-48ae-a5fc-1819ab87641c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61c2c160>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:08.864513 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-3a48fc56-5f3d-48ae-a5fc-1819ab87641c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] HTTP exception thrown: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a48fc56-5f3d-48ae-a5fc-1819ab87641c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Request method failure captured: Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b HTTP/1.1 Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i5QV-z2cPj-dz0uo_rM1WxqC_gJrxR1zf5pxyVPpNADG0iADnUdpbmH_A-0WAG6gH0oKPcbFgjj0hprc3sn2zPrjh5SxkuCWjFmw432shMdwklJAlFVqaSjjqRbNskzXkvMNn1nwhfEv2tmYFcoECao-MXJ_NmUF8mDpS5vxF4RteA Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:08.866900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d6b119ed685b4285b2c7ef69e3df53c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}] Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: c5e013bf52fa45dc8e4b65f183506cf7 Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '04887517-9ae0-4744-a79f-bd96d133ce1b'} Jul 28 06:36:08.872847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. (HTTP 404) (Request-ID: req-faef2f70-0673-45ea-8621-c577ed98a009) Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.874436 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:08.875850 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 06:36:08.877292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-3a48fc56-5f3d-48ae-a5fc-1819ab87641c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Returning 404 to user: Snapshot 04887517-9ae0-4744-a79f-bd96d133ce1b could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:08.879686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-3a48fc56-5f3d-48ae-a5fc-1819ab87641c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b" status: 404 len: 111 microversion: 2.1 time: 0.033161 Jul 28 06:36:08.880717 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 538/1083] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:36:08 2022] GET /compute/v2.1/os-snapshots/04887517-9ae0-4744-a79f-bd96d133ce1b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:36:08.880809 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-deed24b4-32b8-489a-a0a1-e3b69698c16d tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d0f790>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:09.053489 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-deed24b4-32b8-489a-a0a1-e3b69698c16d tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 202 len: 0 microversion: 2.1 time: 0.178594 Jul 28 06:36:09.058127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 546/1084] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:36:08 2022] DELETE /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:36:09.063136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-318eb982-5209-4ab2-b571-9c8b8515fa43 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d3cf70>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:09.118829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-318eb982-5209-4ab2-b571-9c8b8515fa43 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 200 len: 344 microversion: 2.1 time: 0.056612 Jul 28 06:36:09.120889 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 539/1085] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:09 2022] GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:09.126796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:09.126796 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:09.129630 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:09.130123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:09.130972 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:09.131413 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:09.324128 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:09.332565 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0257a884-873f-41fc-97ba-ccfdf03c2922 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.214888 Jul 28 06:36:09.340069 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 547/1086] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:09 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:09.566159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:09.567067 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:09.575006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:09.575862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:09.576784 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:09.577556 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:09.683044 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:09.691206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:09.692806 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d4528589ffa478689e905d47e4c37ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a164b3cd6f444e17ae7ada0e30e62f54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:09.694015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-39919b7e-bd6c-416e-aa95-a40773fa327b tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 200 len: 1656 microversion: 2.20 time: 0.134961 Jul 28 06:36:09.694576 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 540/1087] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:36:09 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 1656 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 06:36:09.822550 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-e68767c8-9359-48ee-90e9-3796e8fd00e9 req-0a3290d1-b46a-489d-aa3b-b8e731e9541c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aeac671-ec0f-40ca-850c-51347aa3dee8", "name": "network-vif-deleted", "tag": "f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:36:09.835915 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-e68767c8-9359-48ee-90e9-3796e8fd00e9 req-0a3290d1-b46a-489d-aa3b-b8e731e9541c service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:09.836712 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-e68767c8-9359-48ee-90e9-3796e8fd00e9 req-0a3290d1-b46a-489d-aa3b-b8e731e9541c service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:09.849129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-e68767c8-9359-48ee-90e9-3796e8fd00e9 req-0a3290d1-b46a-489d-aa3b-b8e731e9541c service nova] Creating event network-vif-deleted:f7f0b1bd-d0b1-4512-ae6d-0afe7fe6f9dd for instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 on hv-cinder-81242 Jul 28 06:36:09.854392 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-e68767c8-9359-48ee-90e9-3796e8fd00e9 req-0a3290d1-b46a-489d-aa3b-b8e731e9541c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036637 Jul 28 06:36:09.855579 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 548/1088] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:10.135213 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bbcedb11-9171-408a-9855-ca119e939c49 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d3c3a0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:10.166394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-bbcedb11-9171-408a-9855-ca119e939c49 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] HTTP exception thrown: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bbcedb11-9171-408a-9855-ca119e939c49 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Request method failure captured: Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 HTTP/1.1 Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i5QV-z2cPj-dz0uo_rM1WxqC_gJrxR1zf5pxyVPpNADG0iADnUdpbmH_A-0WAG6gH0oKPcbFgjj0hprc3sn2zPrjh5SxkuCWjFmw432shMdwklJAlFVqaSjjqRbNskzXkvMNn1nwhfEv2tmYFcoECao-MXJ_NmUF8mDpS5vxF4RteA Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:10.168544 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d6b119ed685b4285b2c7ef69e3df53c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}] Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: c5e013bf52fa45dc8e4b65f183506cf7 Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'a854a963-503d-410d-ad7b-f08f29589453'} Jul 28 06:36:10.170115 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. (HTTP 404) (Request-ID: req-cf3d7f3a-db07-4421-9322-c835fe6da3e6) Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.171103 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:10.172262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:36:10.173435 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bbcedb11-9171-408a-9855-ca119e939c49 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Returning 404 to user: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bbcedb11-9171-408a-9855-ca119e939c49 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 404 len: 109 microversion: 2.1 time: 0.038960 Jul 28 06:36:10.181116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 541/1089] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:10 2022] GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:36:10.182559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5b4c3f1a-3857-4c45-8235-e86b6b2a6d63 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61c398b0>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:10.209841 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-5b4c3f1a-3857-4c45-8235-e86b6b2a6d63 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] HTTP exception thrown: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5b4c3f1a-3857-4c45-8235-e86b6b2a6d63 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Request method failure captured: Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: DELETE /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 HTTP/1.1 Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i5QV-z2cPj-dz0uo_rM1WxqC_gJrxR1zf5pxyVPpNADG0iADnUdpbmH_A-0WAG6gH0oKPcbFgjj0hprc3sn2zPrjh5SxkuCWjFmw432shMdwklJAlFVqaSjjqRbNskzXkvMNn1nwhfEv2tmYFcoECao-MXJ_NmUF8mDpS5vxF4RteA Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:36:10.211983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d6b119ed685b4285b2c7ef69e3df53c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}] Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: c5e013bf52fa45dc8e4b65f183506cf7 Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'a854a963-503d-410d-ad7b-f08f29589453'} Jul 28 06:36:10.214663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. (HTTP 404) (Request-ID: req-93b1ac68-7d9c-41a4-a6ba-9954301396ef) Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.216663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 06:36:10.228467 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 06:36:10.229922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5b4c3f1a-3857-4c45-8235-e86b6b2a6d63 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Returning 404 to user: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:10.231325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5b4c3f1a-3857-4c45-8235-e86b6b2a6d63 tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 404 len: 109 microversion: 2.1 time: 0.036502 Jul 28 06:36:10.232299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 549/1090] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:36:10 2022] DELETE /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:36:10.232398 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9fc26327-3f1b-4945-9acb-474a242ffb7c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Calling method '.version_select at 0x7fbe61d22790>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:10.256939 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-9fc26327-3f1b-4945-9acb-474a242ffb7c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] HTTP exception thrown: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9fc26327-3f1b-4945-9acb-474a242ffb7c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Request method failure captured: Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 HTTP/1.1 Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i5QV-z2cPj-dz0uo_rM1WxqC_gJrxR1zf5pxyVPpNADG0iADnUdpbmH_A-0WAG6gH0oKPcbFgjj0hprc3sn2zPrjh5SxkuCWjFmw432shMdwklJAlFVqaSjjqRbNskzXkvMNn1nwhfEv2tmYFcoECao-MXJ_NmUF8mDpS5vxF4RteA Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:10.259179 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d6b119ed685b4285b2c7ef69e3df53c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d6b119ed685b4285b2c7ef69e3df53c4"}]}] Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: d6b119ed685b4285b2c7ef69e3df53c4 Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168777248 Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: c5e013bf52fa45dc8e4b65f183506cf7 Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168777248-project Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'a854a963-503d-410d-ad7b-f08f29589453'} Jul 28 06:36:10.260756 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. (HTTP 404) (Request-ID: req-069e61e2-505a-4aa6-8152-7fc4ec32843b) Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.261791 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:10.263047 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:36:10.264735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. Jul 28 06:36:10.266009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.267592 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9fc26327-3f1b-4945-9acb-474a242ffb7c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] Returning 404 to user: Volume a854a963-503d-410d-ad7b-f08f29589453 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:10.268452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9fc26327-3f1b-4945-9acb-474a242ffb7c tempest-VolumesSnapshotsTestJSON-1168777248 tempest-VolumesSnapshotsTestJSON-1168777248-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453" status: 404 len: 109 microversion: 2.1 time: 0.050338 Jul 28 06:36:10.269009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 542/1091] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:10 2022] GET /compute/v2.1/os-volumes/a854a963-503d-410d-ad7b-f08f29589453 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:36:10.355663 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:10.356911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:10.366498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:10.366999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:10.371364 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:10.371840 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:10.584107 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:10.591788 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e3d929eb-3f0f-4c07-86ca-cc8208dace80 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.240699 Jul 28 06:36:10.592377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 550/1092] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:10 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:10.718155 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:10.718782 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:10.725292 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:10.726010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:10.726816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:10.729341 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:10.742192 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] HTTP exception thrown: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Request method failure captured: Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 HTTP/1.1 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyLAhONqwdvmcvpgSBT7hHbZDiWHN0vv_53aIAXx7mJga4bkT1xNH2Zp0xQ18hvT_8NZ2J5c4rMymS90gjEKFhm4j0AdUn-1UqWbFzwOCTahDBexx-Vc1_PIxvHTMZXZlPy_gYz36rOo4MSR74loe2014Q9bJ-gDwbcUoG9TzaS28w Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:10.743998 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a164b3cd6f444e17ae7ada0e30e62f54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}] Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 6d4528589ffa478689e905d47e4c37ee Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:10.745669 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '6aeac671-ec0f-40ca-850c-51347aa3dee8'} Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:10.746623 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:10.748276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:10.752196 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Returning 404 to user: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:10.758105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-df72e7ac-af0b-4aaf-95b8-0ee2f6b4dd98 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 404 len: 111 microversion: 2.20 time: 0.043889 Jul 28 06:36:10.762057 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 543/1093] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:36:10 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:36:10.767412 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4017735f-556d-4a41-a86b-e9886e603f62 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '.version_select at 0x7fbe61c39a60>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:10.853580 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4017735f-556d-4a41-a86b-e9886e603f62 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572317512" status: 204 len: 0 microversion: 2.20 time: 0.090176 Jul 28 06:36:10.855766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 551/1094] 10.222.0.69 () {60 vars in 1262 bytes} [Thu Jul 28 06:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572317512 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 06:36:11.618867 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:11.619955 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:11.631286 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:11.632097 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:11.642996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:11.643816 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:11.675064 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:11.845814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:11.857036 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ebed983b-4844-4246-bdb7-6d3fa03cad45 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1756 microversion: 2.1 time: 0.246317 Jul 28 06:36:11.857653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 544/1095] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:11 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:12.856875 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c9e691ad-e196-457a-893e-98f52727e782 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Action: 'create', calling method: .version_select at 0x7fbe61c71d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1152686701", "metadata": {"Type": "work"}}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:36:12.882013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:12.887276 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:12.890312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:12.890707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:12.891490 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:12.891922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:13.046471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:36:13.054731 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d0359362-7d1b-4647-a5f0-57e14779cdfa tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1759 microversion: 2.1 time: 0.177857 Jul 28 06:36:13.058995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 545/1096] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:36:12 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:36:13.358750 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:13.368429 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:13.371394 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:36:13.373514 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:13.374125 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:13.375097 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:13.375746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:13.391220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] HTTP exception thrown: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Request method failure captured: Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 HTTP/1.1 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyLAhONqwdvmcvpgSBT7hHbZDiWHN0vv_53aIAXx7mJga4bkT1xNH2Zp0xQ18hvT_8NZ2J5c4rMymS90gjEKFhm4j0AdUn-1UqWbFzwOCTahDBexx-Vc1_PIxvHTMZXZlPy_gYz36rOo4MSR74loe2014Q9bJ-gDwbcUoG9TzaS28w Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:13.392822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a164b3cd6f444e17ae7ada0e30e62f54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}] Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 6d4528589ffa478689e905d47e4c37ee Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.395567 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '6aeac671-ec0f-40ca-850c-51347aa3dee8'} Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:13.397013 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.399737 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.402338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Returning 404 to user: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:13.402338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-94c64eed-0db0-4f27-aa53-845e9cc63a95 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 404 len: 111 microversion: 2.20 time: 0.040774 Jul 28 06:36:13.402338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 546/1097] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Jul 28 06:36:13 2022] DELETE /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 06:36:13.403395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:13.404015 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: 6aeac671-ec0f-40ca-850c-51347aa3dee8] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:13.410302 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:13.410760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:13.411540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:13.412311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:13.431846 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] HTTP exception thrown: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Request method failure captured: Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 HTTP/1.1 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyLAhONqwdvmcvpgSBT7hHbZDiWHN0vv_53aIAXx7mJga4bkT1xNH2Zp0xQ18hvT_8NZ2J5c4rMymS90gjEKFhm4j0AdUn-1UqWbFzwOCTahDBexx-Vc1_PIxvHTMZXZlPy_gYz36rOo4MSR74loe2014Q9bJ-gDwbcUoG9TzaS28w Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:13.433600 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a164b3cd6f444e17ae7ada0e30e62f54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}] Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 6d4528589ffa478689e905d47e4c37ee Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.435338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': '6aeac671-ec0f-40ca-850c-51347aa3dee8'} Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:13.437056 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. Jul 28 06:36:13.438626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:13.439774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Returning 404 to user: Instance 6aeac671-ec0f-40ca-850c-51347aa3dee8 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:13.439774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6fed0373-b682-4a54-9383-115bdd43008c tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8" status: 404 len: 111 microversion: 2.20 time: 0.035341 Jul 28 06:36:13.439774 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 547/1098] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:36:13 2022] GET /compute/v2.1/servers/6aeac671-ec0f-40ca-850c-51347aa3dee8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 06:36:13.704498 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c9e691ad-e196-457a-893e-98f52727e782 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.006685 Jul 28 06:36:13.705130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 552/1099] 10.222.0.69 () {60 vars in 1156 bytes} [Thu Jul 28 06:36:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 06:36:13.718707 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-c850239c-ac67-484a-98f3-1a42dddf779e tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Calling method '.version_select at 0x7fbe61c9e790>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:13.775156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-c850239c-ac67-484a-98f3-1a42dddf779e tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f" status: 200 len: 353 microversion: 2.1 time: 0.060913 Jul 28 06:36:13.775727 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 548/1100] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:13 2022] GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:14.793520 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-300f30c7-7e88-457d-93b9-37b0e55d220d tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Calling method '.version_select at 0x7fbe61cd9d30>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:14.807362 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:14.808573 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:14.822873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:14.823336 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:14.824116 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:14.824562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:14.838779 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] HTTP exception thrown: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Request method failure captured: Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e HTTP/1.1 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4iyLAhONqwdvmcvpgSBT7hHbZDiWHN0vv_53aIAXx7mJga4bkT1xNH2Zp0xQ18hvT_8NZ2J5c4rMymS90gjEKFhm4j0AdUn-1UqWbFzwOCTahDBexx-Vc1_PIxvHTMZXZlPy_gYz36rOo4MSR74loe2014Q9bJ-gDwbcUoG9TzaS28w Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:36:14.840367 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a164b3cd6f444e17ae7ada0e30e62f54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}] Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 6d4528589ffa478689e905d47e4c37ee Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.842023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e'} Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:14.843105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.844626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.853294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Returning 404 to user: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:14.853294 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58fe7b4b-d904-493e-8a41-52184c7ec145 tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 404 len: 111 microversion: 2.20 time: 0.038898 Jul 28 06:36:14.853559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-300f30c7-7e88-457d-93b9-37b0e55d220d tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f" status: 200 len: 354 microversion: 2.1 time: 0.060163 Jul 28 06:36:14.853559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 553/1101] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:14 2022] GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:14.853728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 549/1102] 10.222.0.69 () {60 vars in 1280 bytes} [Thu Jul 28 06:36:14 2022] DELETE /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 06:36:14.854061 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:14.854676 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] [instance: dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:36:14.859341 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bf3326bc-6ea8-4a1d-b986-d5b4e6a01489 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Calling method '.version_select at 0x7fbe61b18670>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:14.863335 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:14.863335 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:14.863335 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:36:14.863845 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:36:14.879878 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] HTTP exception thrown: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Request method failure captured: Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e HTTP/1.1 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4iyLAhONqwdvmcvpgSBT7hHbZDiWHN0vv_53aIAXx7mJga4bkT1xNH2Zp0xQ18hvT_8NZ2J5c4rMymS90gjEKFhm4j0AdUn-1UqWbFzwOCTahDBexx-Vc1_PIxvHTMZXZlPy_gYz36rOo4MSR74loe2014Q9bJ-gDwbcUoG9TzaS28w Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:36:14.881608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a164b3cd6f444e17ae7ada0e30e62f54", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a164b3cd6f444e17ae7ada0e30e62f54"}]}] Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: a164b3cd6f444e17ae7ada0e30e62f54 Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987468231 Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 6d4528589ffa478689e905d47e4c37ee Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987468231-project Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.888752 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e'} Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:14.890328 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. Jul 28 06:36:14.891890 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:14.893463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] Returning 404 to user: Instance dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:14.893463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a8e075b6-c5df-4eec-8889-87882e84b0bd tempest-AttachVolumeShelveTestJSON-1987468231 tempest-AttachVolumeShelveTestJSON-1987468231-project] 10.222.0.69 "GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e" status: 404 len: 111 microversion: 2.20 time: 0.032752 Jul 28 06:36:14.893463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 554/1103] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 28 06:36:14 2022] GET /compute/v2.1/servers/dc85fcb0-6b16-4e14-b9a1-b3f63965ad7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 06:36:14.910472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bf3326bc-6ea8-4a1d-b986-d5b4e6a01489 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f" status: 200 len: 354 microversion: 2.1 time: 0.054669 Jul 28 06:36:14.911090 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 550/1104] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:14 2022] GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:14.929132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e0b3a407-153e-4f25-885b-200185f94dbb tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Calling method '.version_select at 0x7fbe61b74550>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:15.135948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e0b3a407-153e-4f25-885b-200185f94dbb tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f" status: 202 len: 0 microversion: 2.1 time: 0.211647 Jul 28 06:36:15.136510 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 555/1105] 10.222.0.69 () {58 vars in 1248 bytes} [Thu Jul 28 06:36:14 2022] DELETE /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:36:15.144835 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-51c8dc60-fc24-4760-b0d5-26dbc84ec90b tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Calling method '.version_select at 0x7fbe625deaf0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:15.197232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-51c8dc60-fc24-4760-b0d5-26dbc84ec90b tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f" status: 200 len: 353 microversion: 2.1 time: 0.056161 Jul 28 06:36:15.197921 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 551/1106] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:15 2022] GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:36:16.213182 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-af7a61cf-e918-429a-8160-0d70eebc09f7 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Calling method '.version_select at 0x7fbe61cf6a60>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:36:16.242357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-af7a61cf-e918-429a-8160-0d70eebc09f7 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] HTTP exception thrown: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-af7a61cf-e918-429a-8160-0d70eebc09f7 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Request method failure captured: Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f HTTP/1.1 Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i5cWxjQ6wU5Icm_WBixRRsX8v1Vn5lZARmo88n05MRmSqXjQqvxEBapxL0I-JqavSckZ4DLOFaaNIRqAWqRzEFdeRfIjuVuFThXUeqPZnLC9UP3zY5AmBXy_4v9jslr_TveGp0v5APMVzNX00iRw8ermCrnjJ3vepu9M3CnGarRQ2o Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: a420b01a5b8348b290f1ad5c9852f524 Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-VolumesGetTestJSON-2083355032 Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:36:16.244295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a420b01a5b8348b290f1ad5c9852f524"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a420b01a5b8348b290f1ad5c9852f524", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a420b01a5b8348b290f1ad5c9852f524"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a420b01a5b8348b290f1ad5c9852f524"}]}] Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-VolumesGetTestJSON-2083355032 Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: a420b01a5b8348b290f1ad5c9852f524 Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-VolumesGetTestJSON-2083355032 Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-VolumesGetTestJSON-2083355032-project Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 6b3e6241a9f247279e72d81718f55b3d Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-VolumesGetTestJSON-2083355032-project Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': '1f1f983f-eb52-474c-b3a6-74d7cda8d62f'} Jul 28 06:36:16.246031 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. (HTTP 404) (Request-ID: req-7faedcb2-ce10-44d5-9ad1-9cb6096628d5) Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:16.247030 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 06:36:16.248235 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 06:36:16.250687 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-af7a61cf-e918-429a-8160-0d70eebc09f7 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] Returning 404 to user: Volume 1f1f983f-eb52-474c-b3a6-74d7cda8d62f could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-af7a61cf-e918-429a-8160-0d70eebc09f7 tempest-VolumesGetTestJSON-2083355032 tempest-VolumesGetTestJSON-2083355032-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f" status: 404 len: 109 microversion: 2.1 time: 0.037724 Jul 28 06:36:16.253067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 556/1107] 10.222.0.69 () {58 vars in 1245 bytes} [Thu Jul 28 06:36:16 2022] GET /compute/v2.1/os-volumes/1f1f983f-eb52-474c-b3a6-74d7cda8d62f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:16.658994 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=15 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:16.659828 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=5 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:16.664580 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1868824558"}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:16.665183 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:16.672790 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:16.673462 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:16.674402 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:16.674895 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:16.816259 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.network.security_group_api [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Removing security group 2af970f6-abe0-4f63-a6b4-2db1e10f5343 from port 1180a354-41d4-4d24-8328-e75871937ec8 Jul 28 06:37:17.307900 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf9c5fdf-b49a-4246-89ac-64f9f9ee6fdf tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/action" status: 202 len: 0 microversion: 2.1 time: 0.650767 Jul 28 06:37:17.309052 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 552/1108] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:37:16 2022] POST /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:37:17.315783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:17.315783 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:17.321058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-9f7ac1b2-b1cc-4d89-a2ea-7959056c314c req-8356f42a-75d5-49c3-ba1c-c1d168a4a7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:17.339357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-9f7ac1b2-b1cc-4d89-a2ea-7959056c314c req-8356f42a-75d5-49c3-ba1c-c1d168a4a7d5 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:17.339864 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-9f7ac1b2-b1cc-4d89-a2ea-7959056c314c req-8356f42a-75d5-49c3-ba1c-c1d168a4a7d5 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:17.373179 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-9f7ac1b2-b1cc-4d89-a2ea-7959056c314c req-8356f42a-75d5-49c3-ba1c-c1d168a4a7d5 service nova] Creating event network-changed:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:37:17.379641 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-9f7ac1b2-b1cc-4d89-a2ea-7959056c314c req-8356f42a-75d5-49c3-ba1c-c1d168a4a7d5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066711 Jul 28 06:37:17.380859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 557/1109] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:19.126604 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:19.127118 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:19.129489 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-c1a2846f-80a4-491e-83c6-59b90454806e req-56f3643e-aa21-401c-a37c-e89c36982c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:19.143169 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c1a2846f-80a4-491e-83c6-59b90454806e req-56f3643e-aa21-401c-a37c-e89c36982c4f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:19.143983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c1a2846f-80a4-491e-83c6-59b90454806e req-56f3643e-aa21-401c-a37c-e89c36982c4f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:19.145631 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:19.146162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:19.152100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:19.152100 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:19.161361 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-c1a2846f-80a4-491e-83c6-59b90454806e req-56f3643e-aa21-401c-a37c-e89c36982c4f service nova] Creating event network-changed:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:37:19.169136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-c1a2846f-80a4-491e-83c6-59b90454806e req-56f3643e-aa21-401c-a37c-e89c36982c4f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043618 Jul 28 06:37:19.171026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 558/1110] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:37:19.304121 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.objects.instance [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lazy-loading 'services' on Instance uuid e023915e-896b-42ba-9e22-4ef71c9e0867 {{(pid=118387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:37:19.653647 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d9d55312-84fd-4b4e-88ac-bf23c0a41910 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments/3a2d4992-8f24-41c0-8d2f-6b78f1b2b400" status: 202 len: 0 microversion: 2.1 time: 0.531150 Jul 28 06:37:19.654324 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 553/1111] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:37:19 2022] DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments/3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:37:19.665990 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:19.671462 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:19.682188 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:19.683336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:19.684457 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:19.684974 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:19.727146 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ecebcccb-cd22-4841-91c5-e2a3e0883a7d tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067220 Jul 28 06:37:19.728902 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 559/1112] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:37:19 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:20.742909 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:20.746131 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:20.752758 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:20.753473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:20.754416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:20.755006 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:20.787145 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-903f76a9-9e60-4534-b6dc-2c9c94612c67 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049007 Jul 28 06:37:20.787713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 554/1113] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:37:20 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:21.801022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:21.803228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:21.810732 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:21.811203 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:21.812310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:21.812439 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:21.845155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-951391e9-d05b-447a-ae40-ee079d58f4c9 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048110 Jul 28 06:37:21.845762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 560/1114] 10.222.0.69 () {58 vars in 1302 bytes} [Thu Jul 28 06:37:21 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 06:37:21.856951 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:21.858058 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:21.864666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:21.865120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:21.865930 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:21.866374 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:21.941802 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] HTTP exception thrown: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 is not attached to volume 3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Request method failure captured: Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments/3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 HTTP/1.1 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i3xY1dnnA1w5jWmebRj8W5AEVgt5uuUS_-OlAzjaoEzy1f35k0bjWLrvYIf6Wo6SSisYVXRR7f5hWchRBC-xrVWCEu--rjDvcZ-6UTB0XZWYOgOfjHMqKg4haSDQRcb7eFJwxcYDAktU2ror8N7IWr7YIfSIkYnlkHuxPWNuOmgJbM Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: d45f04c2af574b889ee776b6a0fa9d40 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestMinimumBasicScenario-780074641 Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:37:21.951709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d45f04c2af574b889ee776b6a0fa9d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d45f04c2af574b889ee776b6a0fa9d40", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d45f04c2af574b889ee776b6a0fa9d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d45f04c2af574b889ee776b6a0fa9d40"}]}] Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestMinimumBasicScenario-780074641 Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: d45f04c2af574b889ee776b6a0fa9d40 Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestMinimumBasicScenario-780074641 Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-TestMinimumBasicScenario-780074641-project Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 677cbef82d164fa8bd0a24afc4012cf7 Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestMinimumBasicScenario-780074641-project Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:37:21.953540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 is not attached to volume 3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'server_id': 'e023915e-896b-42ba-9e22-4ef71c9e0867', 'id': '3a2d4992-8f24-41c0-8d2f-6b78f1b2b400'} Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3a2d4992-8f24-41c0-8d2f-6b78f1b2b400. Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:37:21.954453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 is not attached to volume 3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 is not attached to volume 3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:21.955829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Returning 404 to user: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 is not attached to volume 3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:37:21.957157 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cb19c071-9f26-4e3f-8cfd-63f4dd4058d6 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments/3a2d4992-8f24-41c0-8d2f-6b78f1b2b400" status: 404 len: 154 microversion: 2.1 time: 0.100888 Jul 28 06:37:21.957157 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 555/1115] 10.222.0.69 () {58 vars in 1416 bytes} [Thu Jul 28 06:37:21 2022] DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867/os-volume_attachments/3a2d4992-8f24-41c0-8d2f-6b78f1b2b400 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:23.314519 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:23.315190 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:23.321472 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:23.321919 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:23.322685 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:23.323122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:23.348855 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Going to try to terminate instance {{(pid=118388) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:37:23.700780 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ab1185b5-161d-462c-8115-a11a9d71551f tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 204 len: 0 microversion: 2.1 time: 0.389294 Jul 28 06:37:23.701674 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 561/1116] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:37:23 2022] DELETE /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:37:23.710158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:23.710777 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:23.718167 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:23.718620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:23.719401 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:23.719840 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:23.866673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:23.875091 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-83dece65-1b65-441b-b87b-a6c027c00dc3 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1553 microversion: 2.1 time: 0.168919 Jul 28 06:37:23.875620 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 556/1117] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:23 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:37:24.898399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:24.899106 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:24.905804 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:24.906256 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:24.907025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:24.907463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:25.037278 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:25.045406 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d8ad3999-72be-4cdf-8fcb-ba92568db074 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1553 microversion: 2.1 time: 0.151284 Jul 28 06:37:25.045982 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 562/1118] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:24 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:26.066634 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:26.067306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:26.073776 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:26.074216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:26.075884 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:26.076323 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:26.215142 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:26.223217 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-284ec617-203a-4733-b3e6-f15d0a7aad51 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1553 microversion: 2.1 time: 0.160458 Jul 28 06:37:26.223798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 557/1119] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:26 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:27.244703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:27.245377 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:27.252108 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:27.252625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:27.253330 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:27.253774 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:27.474494 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:27.482542 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3e13413c-8398-4f8d-9193-d6246d9afb0c tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1553 microversion: 2.1 time: 0.241628 Jul 28 06:37:27.483126 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 563/1120] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:27 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:27.873672 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-eeb64f98-c775-4084-9d48-dca22fdf7f0e req-95e47160-402f-4292-afa2-f49a3aca9b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e023915e-896b-42ba-9e22-4ef71c9e0867", "name": "network-vif-deleted", "tag": "1180a354-41d4-4d24-8328-e75871937ec8"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:27.884106 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-eeb64f98-c775-4084-9d48-dca22fdf7f0e req-95e47160-402f-4292-afa2-f49a3aca9b5f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:27.884556 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-eeb64f98-c775-4084-9d48-dca22fdf7f0e req-95e47160-402f-4292-afa2-f49a3aca9b5f service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:27.897813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-eeb64f98-c775-4084-9d48-dca22fdf7f0e req-95e47160-402f-4292-afa2-f49a3aca9b5f service nova] Creating event network-vif-deleted:1180a354-41d4-4d24-8328-e75871937ec8 for instance e023915e-896b-42ba-9e22-4ef71c9e0867 on hv-cinder-81242 Jul 28 06:37:27.904310 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-eeb64f98-c775-4084-9d48-dca22fdf7f0e req-95e47160-402f-4292-afa2-f49a3aca9b5f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034847 Jul 28 06:37:27.904923 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 558/1121] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:28.504062 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:28.504831 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:28.511751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.512212 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:28.513596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.513753 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:28.544913 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:28.545399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:28.545852 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lazy-loading 'fault' on Instance uuid e023915e-896b-42ba-9e22-4ef71c9e0867 {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:37:28.587594 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677cbef82d164fa8bd0a24afc4012cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45f04c2af574b889ee776b6a0fa9d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:28.595556 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3a0c7160-071c-43a8-bde0-b0e84317f46a tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 200 len: 1348 microversion: 2.1 time: 0.095626 Jul 28 06:37:28.596130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 564/1122] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:28 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:29.617746 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:29.618454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] [instance: e023915e-896b-42ba-9e22-4ef71c9e0867] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:29.625129 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:29.625619 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:29.626395 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:29.626830 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:29.640437 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] HTTP exception thrown: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 could not be found. Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Request method failure captured: Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 HTTP/1.1 Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i3xY1dnnA1w5jWmebRj8W5AEVgt5uuUS_-OlAzjaoEzy1f35k0bjWLrvYIf6Wo6SSisYVXRR7f5hWchRBC-xrVWCEu--rjDvcZ-6UTB0XZWYOgOfjHMqKg4haSDQRcb7eFJwxcYDAktU2ror8N7IWr7YIfSIkYnlkHuxPWNuOmgJbM Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: d45f04c2af574b889ee776b6a0fa9d40 Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestMinimumBasicScenario-780074641 Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:37:29.642087 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d45f04c2af574b889ee776b6a0fa9d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d45f04c2af574b889ee776b6a0fa9d40", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d45f04c2af574b889ee776b6a0fa9d40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d45f04c2af574b889ee776b6a0fa9d40"}]}] Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestMinimumBasicScenario-780074641 Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: d45f04c2af574b889ee776b6a0fa9d40 Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestMinimumBasicScenario-780074641 Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-TestMinimumBasicScenario-780074641-project Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: 677cbef82d164fa8bd0a24afc4012cf7 Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestMinimumBasicScenario-780074641-project Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 could not be found. Jul 28 06:37:29.643754 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'e023915e-896b-42ba-9e22-4ef71c9e0867'} Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 could not be found. Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:37:29.644855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 could not be found. Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 could not be found. Jul 28 06:37:29.646456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:37:29.648216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Returning 404 to user: Instance e023915e-896b-42ba-9e22-4ef71c9e0867 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:37:29.648216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-cf43ede8-b935-4918-80cb-fbd6425d194e tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867" status: 404 len: 111 microversion: 2.1 time: 0.029986 Jul 28 06:37:29.648216 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 559/1123] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:29 2022] GET /compute/v2.1/servers/e023915e-896b-42ba-9e22-4ef71c9e0867 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:37:29.652527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5eb991c4-c54e-4175-a28c-cc5dad7ede43 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] Calling method '.version_select at 0x7fbe61c71d30>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:29.735638 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5eb991c4-c54e-4175-a28c-cc5dad7ede43 tempest-TestMinimumBasicScenario-780074641 tempest-TestMinimumBasicScenario-780074641-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-975705745" status: 202 len: 0 microversion: 2.1 time: 0.086894 Jul 28 06:37:29.736268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 565/1124] 10.222.0.69 () {58 vars in 1269 bytes} [Thu Jul 28 06:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-975705745 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:37:45.320657 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1870357189", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-251647084", "security_groups": [{"name": "tempest-secgroup-smoke-546945479"}], "block_device_mapping_v2": [{"uuid": "7a35ba98-e58e-4013-8b80-a46871ad66e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd87854f-57d2-4562-b1ab-837a717d2f52"}]}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:45.331456 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=16 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:45.332113 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:45.440204 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.network.neutron [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] validate_networks() for [('dd87854f-57d2-4562-b1ab-837a717d2f52', None, None, None, None, None)] {{(pid=118387) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:37:45.824972 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Flavor limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:37:45.825536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Image limits 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:37:45.826862 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Flavor pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:37:45.827286 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Image pref 0:0:0 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:37:45.827706 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.virt.hardware [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:37:45.836978 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.837465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.838271 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:45.838712 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:45.855571 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for project 47b406d9a12c461a84aa0331d2890990. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:37:45.859893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Getting quotas for user b1868c7d0ec8443b9ccb698ee02928b6 and project 47b406d9a12c461a84aa0331d2890990. Resources: {'ram', 'cores', 'instances'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:37:45.917082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Going to run 1 instances... {{(pid=118387) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:37:45.919275 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a35ba98-e58e-4013-8b80-a46871ad66e9',volume_size=None,volume_type=None)] {{(pid=118387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:37:46.298205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [076ca04f-41a1-4ba0-9f27-92367ca71fa8] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 06:37:47.307159 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [076ca04f-41a1-4ba0-9f27-92367ca71fa8] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43762. Jul 28 06:37:47.312023 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2b7c8557-1f8f-4d95-8c56-fa6956d06979 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.995461 Jul 28 06:37:47.312713 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 560/1125] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:37:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:37:47.321408 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:47.322611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:47.326766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f37fffb4-39c6-4a4a-b91f-08448bd47a40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:47.327463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f37fffb4-39c6-4a4a-b91f-08448bd47a40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:47.387109 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f37fffb4-39c6-4a4a-b91f-08448bd47a40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:47.395012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f37fffb4-39c6-4a4a-b91f-08448bd47a40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1094 microversion: 2.1 time: 0.075078 Jul 28 06:37:47.395573 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 566/1126] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:47 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:48.416494 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a3742d9a-f9e9-49e7-aa82-72c198531f2f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:48.417181 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a3742d9a-f9e9-49e7-aa82-72c198531f2f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:48.471474 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a3742d9a-f9e9-49e7-aa82-72c198531f2f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:48.478274 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a3742d9a-f9e9-49e7-aa82-72c198531f2f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1094 microversion: 2.1 time: 0.066162 Jul 28 06:37:48.478838 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 561/1127] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:48 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:49.500861 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9b5767ec-452d-4021-8fd3-f321af8cff11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:49.503155 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9b5767ec-452d-4021-8fd3-f321af8cff11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:49.561813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-9b5767ec-452d-4021-8fd3-f321af8cff11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:49.569708 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9b5767ec-452d-4021-8fd3-f321af8cff11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1094 microversion: 2.1 time: 0.073714 Jul 28 06:37:49.570835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 567/1128] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:49 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:50.592501 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6f1f4f74-ccad-40b1-8fa9-1e46e2b6fa11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:50.593031 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6f1f4f74-ccad-40b1-8fa9-1e46e2b6fa11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:50.661376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6f1f4f74-ccad-40b1-8fa9-1e46e2b6fa11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:50.668498 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6f1f4f74-ccad-40b1-8fa9-1e46e2b6fa11 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1094 microversion: 2.1 time: 0.080658 Jul 28 06:37:50.670120 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 562/1129] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:50 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:51.691047 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:51.691713 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:51.700029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:51.701142 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:51.702058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:51.702438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:51.825041 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:51.834057 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-57d6b0aa-b209-4322-be7d-5caf8842c2de tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1144 microversion: 2.1 time: 0.146771 Jul 28 06:37:51.842668 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 568/1130] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:51 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1144 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:52.855210 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:52.856751 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:52.864186 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.864724 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.865647 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:52.866306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:52.947709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:52.966835 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-75878d30-de94-4585-8ba8-8a39422070c8 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1192 microversion: 2.1 time: 0.114529 Jul 28 06:37:52.968596 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 563/1131] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:52 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:53.997492 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:53.998341 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:54.007067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.007067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.007067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:54.007067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:54.145591 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:54.156017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-af6a891b-7aef-47ba-86e8-2c5420ed1f4a tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1210 microversion: 2.1 time: 0.162369 Jul 28 06:37:54.165635 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 569/1132] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:53 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1210 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:55.178262 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:55.178878 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:55.186445 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:55.186894 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:55.187864 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:55.188306 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:55.384745 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:55.394020 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1058eca7-abf5-4f10-b562-5404589085e3 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.219669 Jul 28 06:37:55.410700 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 564/1133] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:55 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:56.122158 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-1b597fe5-c7a4-4d50-af06-d0b738344964 req-07b5aa04-98c4-4e75-bc6b-a4f9841cdd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb42f64-42df-4d6f-85c7-67cca4f6492b", "tag": "6ebf1019-d3cf-46bd-8c5b-46f7f329eccb"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:37:56.136976 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-1b597fe5-c7a4-4d50-af06-d0b738344964 req-07b5aa04-98c4-4e75-bc6b-a4f9841cdd2e service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.137470 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-1b597fe5-c7a4-4d50-af06-d0b738344964 req-07b5aa04-98c4-4e75-bc6b-a4f9841cdd2e service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.153249 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-1b597fe5-c7a4-4d50-af06-d0b738344964 req-07b5aa04-98c4-4e75-bc6b-a4f9841cdd2e service nova] Creating event network-changed:6ebf1019-d3cf-46bd-8c5b-46f7f329eccb for instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b on hv-cinder-81242 Jul 28 06:37:56.159228 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-1b597fe5-c7a4-4d50-af06-d0b738344964 req-07b5aa04-98c4-4e75-bc6b-a4f9841cdd2e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041277 Jul 28 06:37:56.161602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 570/1134] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:37:56.418993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:56.421075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:56.428063 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:37:56.433465 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.434199 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.435393 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:56.436414 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:56.650540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:56.659127 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-86ba2492-e0ac-45c0-97e8-4fdb11e1d912 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.244607 Jul 28 06:37:56.673535 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 565/1135] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:56 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:57.681776 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:57.682495 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:57.689147 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.689653 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.690479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:57.690918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:57.880797 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:57.896835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-66c22828-d312-4e73-ac04-00219863d637 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.219744 Jul 28 06:37:57.901083 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 571/1136] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:57 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:37:58.920153 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:37:58.921243 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:37:58.931128 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.936646 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:58.936646 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:37:58.936646 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:37:59.140236 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:37:59.149577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-04cc820e-1d9e-42f1-8df3-8494bffbbe64 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.234134 Jul 28 06:37:59.150915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 566/1137] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:37:58 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:00.173585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:00.174718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:00.180449 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=4 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:00.188671 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.189484 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.191302 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:00.192790 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:00.385529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:00.394290 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-34a9178b-2088-471b-8769-afca9ceb73a7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.227236 Jul 28 06:38:00.394883 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 572/1138] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:00 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:01.331980 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=10 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:01.416211 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:01.417607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:01.426287 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.427242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.428205 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:01.428741 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:01.529653 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-863b1c32-59dd-40b0-9290-d58c5e4374a4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Action: 'create', calling method: .version_select at 0x7fbe625f3af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-554219014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7jWoJhF4LIBwL+yNC6WaKIGX3Wq2R33J22ZrYrbatdirKpjaOUGZMK6BBjVzX8Jr8nn8GLmiE7dq5Z+Kl6ddiCnjOK7f0+BZrFx8xmg2L2vpIJ3yuKFJ7qw0nKLXsE1A=="}} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:01.548577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-863b1c32-59dd-40b0-9290-d58c5e4374a4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Getting quotas for project 3ce97bbb75d4412e90231e4da14840bc. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:38:01.558914 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.quota [None req-863b1c32-59dd-40b0-9290-d58c5e4374a4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Getting quotas for user 95a22e1003d74332ba4f0ee84b6422e4 and project 3ce97bbb75d4412e90231e4da14840bc. Resources: {'key_pairs'} {{(pid=118387) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:38:01.582189 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:01.590024 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-647a354d-4db5-4f1b-a4d2-ff6995f18f40 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.177755 Jul 28 06:38:01.590605 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 573/1139] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:01 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:01.666092 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-863b1c32-59dd-40b0-9290-d58c5e4374a4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.339134 Jul 28 06:38:01.666893 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 567/1140] 10.222.0.69 () {60 vars in 1159 bytes} [Thu Jul 28 06:38:01 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:02.611454 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:02.612447 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:02.623681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.623681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.623681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:02.623681 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:02.796514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:02.805996 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4d9870e0-161d-475c-b365-fb2b087dc263 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.198509 Jul 28 06:38:02.823661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 574/1141] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:02 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:03.829869 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:03.831412 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:03.840041 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.840492 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:03.841440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:03.841882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:04.038141 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:04.046894 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ffad5642-8a0d-4eaa-834c-47320184f796 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.222465 Jul 28 06:38:04.054913 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 568/1142] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:03 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:05.067762 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:05.068376 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:05.074605 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.075652 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.076540 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:05.076983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:05.211318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:05.219612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-967c3186-9971-4b18-aea4-f717df89a381 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.155565 Jul 28 06:38:05.219983 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 575/1143] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:05 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:06.240514 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:06.241297 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:06.248108 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.248562 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.249372 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.249814 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.296955 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-b33a703e-aac5-4ae5-a492-c31e0a196e4b req-8d566849-6563-48ab-a91e-c1ec4bfe8c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb42f64-42df-4d6f-85c7-67cca4f6492b", "name": "network-vif-plugged", "status": "completed", "tag": "6ebf1019-d3cf-46bd-8c5b-46f7f329eccb"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:06.308585 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-b33a703e-aac5-4ae5-a492-c31e0a196e4b req-8d566849-6563-48ab-a91e-c1ec4bfe8c28 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:06.309033 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-b33a703e-aac5-4ae5-a492-c31e0a196e4b req-8d566849-6563-48ab-a91e-c1ec4bfe8c28 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:06.322869 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-b33a703e-aac5-4ae5-a492-c31e0a196e4b req-8d566849-6563-48ab-a91e-c1ec4bfe8c28 service nova] Creating event network-vif-plugged:6ebf1019-d3cf-46bd-8c5b-46f7f329eccb for instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b on hv-cinder-81242 Jul 28 06:38:06.329588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-b33a703e-aac5-4ae5-a492-c31e0a196e4b req-8d566849-6563-48ab-a91e-c1ec4bfe8c28 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Jul 28 06:38:06.330274 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 576/1144] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:06.414214 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:06.423417 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-369539b1-148d-41a9-8323-464b0bc45601 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.186906 Jul 28 06:38:06.424577 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 569/1145] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:06 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:07.446658 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:07.447358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:07.453838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.454293 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.455067 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:07.455768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:07.598191 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:07.606918 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-abd40a45-5a12-4184-94df-71431ff929ce tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1265 microversion: 2.1 time: 0.164148 Jul 28 06:38:07.611145 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 577/1146] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:07 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:08.628356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:08.628921 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:08.636073 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.636613 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.637557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.638034 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.881874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:08.890078 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-6ec2fdf7-93db-42b2-a616-cb9a63345735 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1452 microversion: 2.1 time: 0.265618 Jul 28 06:38:08.890656 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 570/1147] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:08 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1452 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:08.910272 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:08.910944 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:08.917958 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.918406 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:08.919178 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:08.919615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:09.058722 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:09.066993 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cf7e1976-515b-4a5d-b5a5-d597636f1b22 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1452 microversion: 2.1 time: 0.160404 Jul 28 06:38:09.067560 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 578/1148] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:08 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:11.258255 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-d655464e-4a18-474a-828a-2b8c57a3405a req-9e9c0641-064a-4040-9725-2968d7bdb0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb42f64-42df-4d6f-85c7-67cca4f6492b", "tag": "6ebf1019-d3cf-46bd-8c5b-46f7f329eccb"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:11.269228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-d655464e-4a18-474a-828a-2b8c57a3405a req-9e9c0641-064a-4040-9725-2968d7bdb0ca service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:11.269714 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-d655464e-4a18-474a-828a-2b8c57a3405a req-9e9c0641-064a-4040-9725-2968d7bdb0ca service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:11.283338 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-d655464e-4a18-474a-828a-2b8c57a3405a req-9e9c0641-064a-4040-9725-2968d7bdb0ca service nova] Creating event network-changed:6ebf1019-d3cf-46bd-8c5b-46f7f329eccb for instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b on hv-cinder-81242 Jul 28 06:38:11.288966 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-d655464e-4a18-474a-828a-2b8c57a3405a req-9e9c0641-064a-4040-9725-2968d7bdb0ca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034345 Jul 28 06:38:11.289107 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 571/1149] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:38:20.203987 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1436863670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-554219014", "security_groups": [{"name": "tempest-secgroup-smoke-1522228946"}], "networks": [{"uuid": "4523b400-324e-4557-a908-bbe22983e058"}], "block_device_mapping_v2": [{"uuid": "3830bdfc-b8ab-49af-a240-2d0e654b7f27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:20.214590 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=30 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:20.215479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=58 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:20.432611 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.network.neutron [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] validate_networks() for [('4523b400-324e-4557-a908-bbe22983e058', None, None, None, None, None)] {{(pid=118388) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 06:38:20.815615 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Flavor limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 06:38:20.816046 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Image limits 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 06:38:20.816667 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Flavor pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 06:38:20.817133 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Image pref 0:0:0 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 06:38:20.817548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.virt.hardware [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118388) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 06:38:20.826410 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:20.826857 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:20.827650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:20.828086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:20.846339 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Getting quotas for project 3ce97bbb75d4412e90231e4da14840bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 06:38:20.850316 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.quota [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Getting quotas for user 95a22e1003d74332ba4f0ee84b6422e4 and project 3ce97bbb75d4412e90231e4da14840bc. Resources: {'ram', 'cores', 'instances'} {{(pid=118388) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 06:38:20.907059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Going to run 1 instances... {{(pid=118388) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 06:38:20.909393 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3830bdfc-b8ab-49af-a240-2d0e654b7f27',volume_size=None,volume_type=None)] {{(pid=118388) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 06:38:21.270243 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:38:21.270928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Thu Jul 28 06:38:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.69) !!! Jul 28 06:38:21.370948 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-dc1c79f2-3e46-43b2-944e-28167c9b06d5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.170775 Jul 28 06:38:21.378791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 579/1150] 10.222.0.69 () {60 vars in 1147 bytes} [Thu Jul 28 06:38:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 06:38:21.384732 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bef6fba2-4a8e-4084-9c77-7bfe6fe900bc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:21.385454 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bef6fba2-4a8e-4084-9c77-7bfe6fe900bc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:21.389208 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:21.390699 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:21.391425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=46 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:21.450882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-bef6fba2-4a8e-4084-9c77-7bfe6fe900bc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:21.457932 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bef6fba2-4a8e-4084-9c77-7bfe6fe900bc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1088 microversion: 2.1 time: 0.077750 Jul 28 06:38:21.458525 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 572/1151] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:21 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:38:22.479516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f01e3b97-caaa-4ae6-9fb5-5de8d877e377 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:22.480061 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f01e3b97-caaa-4ae6-9fb5-5de8d877e377 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:22.533751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f01e3b97-caaa-4ae6-9fb5-5de8d877e377 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:22.540493 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f01e3b97-caaa-4ae6-9fb5-5de8d877e377 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1088 microversion: 2.1 time: 0.064770 Jul 28 06:38:22.541266 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 580/1152] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:22 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:23.561674 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d6a3d919-fec1-400d-a151-4ce733435525 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:23.562409 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d6a3d919-fec1-400d-a151-4ce733435525 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:23.619230 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d6a3d919-fec1-400d-a151-4ce733435525 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:23.625981 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d6a3d919-fec1-400d-a151-4ce733435525 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1088 microversion: 2.1 time: 0.068756 Jul 28 06:38:23.626813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 573/1153] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:23 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:24.648445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b6994f8a-6acb-48e2-9bfd-db97b0da848d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:24.649112 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b6994f8a-6acb-48e2-9bfd-db97b0da848d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:24.708700 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b6994f8a-6acb-48e2-9bfd-db97b0da848d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:24.715740 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b6994f8a-6acb-48e2-9bfd-db97b0da848d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1088 microversion: 2.1 time: 0.071732 Jul 28 06:38:24.716336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 581/1154] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:24 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:25.737825 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:25.738463 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:25.745334 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.745793 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.746571 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:25.747010 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:25.814703 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:25.822622 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fdcf0618-094c-4a96-8880-d2bace2fdcdb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1138 microversion: 2.1 time: 0.089748 Jul 28 06:38:25.823205 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 574/1155] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:25 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:26.844213 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:26.844931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:26.851719 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:26.852170 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:26.852941 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:26.853426 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:26.915949 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:26.923829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-b8ece1e9-b871-4cf4-93c4-1693c5d21414 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1130 microversion: 2.1 time: 0.083468 Jul 28 06:38:26.924508 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 582/1156] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:26 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:27.945277 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:27.945945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:27.952373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:27.952819 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:27.954144 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:27.954582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:28.025182 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:28.034001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-1f264ea3-be94-4364-88a2-02a4ce99d3c0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1204 microversion: 2.1 time: 0.092657 Jul 28 06:38:28.037045 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 575/1157] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:27 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:29.059744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:29.059744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:29.063729 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:29.064275 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:29.065138 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:29.065734 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:29.263076 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:29.271397 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-d43731b4-77bd-4c41-b90c-7ede164684aa tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1272 microversion: 2.1 time: 0.219387 Jul 28 06:38:29.271970 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 583/1158] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:29 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:29.365602 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-3cf871b4-6e9f-4df1-8295-a9a83305e319 req-765e6978-40ae-4661-8122-dd628924b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:29.379136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3cf871b4-6e9f-4df1-8295-a9a83305e319 req-765e6978-40ae-4661-8122-dd628924b5c3 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:29.379574 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-3cf871b4-6e9f-4df1-8295-a9a83305e319 req-765e6978-40ae-4661-8122-dd628924b5c3 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:29.398609 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-3cf871b4-6e9f-4df1-8295-a9a83305e319 req-765e6978-40ae-4661-8122-dd628924b5c3 service nova] Creating event network-changed:2e77a9a5-aa49-46ee-9315-297c9ed8b731 for instance e638b92a-b36c-4982-b060-183eac639a1b on hv-cinder-81242 Jul 28 06:38:29.403836 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-3cf871b4-6e9f-4df1-8295-a9a83305e319 req-765e6978-40ae-4661-8122-dd628924b5c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043866 Jul 28 06:38:29.404452 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 576/1159] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:30.292609 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:30.293195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:30.300315 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.300805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.301589 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:30.302026 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:30.450118 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:30.457718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-2a1a4e50-0013-4ed1-ae49-a48efe812049 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.169053 Jul 28 06:38:30.458274 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 584/1160] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:30 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:31.479813 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:31.480542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:31.488581 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:31.489078 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:31.490017 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:31.490466 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:31.626608 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:31.634158 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7115db17-f25d-41fc-a8f0-70671de358f0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.158882 Jul 28 06:38:31.634735 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 577/1161] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:31 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:32.656969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:32.657533 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:32.659821 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:32.665058 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:32.665539 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:32.666318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:32.666746 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:32.800706 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:32.808486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-5ce740cd-c533-4023-9c9a-1b627750d7ba tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.155385 Jul 28 06:38:32.809072 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 585/1162] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:32 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:33.830551 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:33.831193 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:33.833557 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell0:SELECT=4 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:33.839071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:33.839524 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:33.840296 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:33.840740 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:33.972833 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:33.980376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-511c9f5d-8906-42ea-9ca3-81b93f6f2b88 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.154436 Jul 28 06:38:33.980944 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 578/1163] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:33 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:35.001905 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:35.002549 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:35.004392 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell0:SELECT=10 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:38:35.009407 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:35.009867 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:35.010639 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:35.011078 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:35.143737 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:35.151229 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-263629ad-413a-4e05-8c62-69756d67a5d3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.153578 Jul 28 06:38:35.151805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 586/1164] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:34 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:36.171872 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:36.172489 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:36.179325 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:36.179778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:36.180558 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:36.180996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:36.318065 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:36.325592 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-06e72aa5-cf65-467a-83bd-a2c69ea6cd4d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.157688 Jul 28 06:38:36.326162 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 579/1165] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:36 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:37.347185 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:37.347800 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:37.354460 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:37.359000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:37.359000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:37.359000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:37.490626 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:37.498163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-fa06c81e-cd05-4e69-ae21-edb3410c1271 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.155192 Jul 28 06:38:37.498733 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 587/1166] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:37 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:38.519778 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:38.520370 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:38.526863 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:38.527307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:38.528071 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:38.528502 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:38.668393 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:38.676411 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-73dddb76-ac52-4a59-831c-ff896922163e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.160496 Jul 28 06:38:38.676973 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 580/1167] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:38 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:39.696279 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:39.696862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:39.703301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:39.703739 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:39.704882 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:39.705336 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:39.839097 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:39.846794 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-962b0a18-22db-4fdd-b211-8049fc776f81 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.154375 Jul 28 06:38:39.847364 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 588/1168] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:39 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:40.534339 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-491e5c69-e75f-42d5-9aac-054573135099 req-84f1e4c7-a62a-4977-abbd-97482d542fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "name": "network-vif-plugged", "status": "completed", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:40.544373 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-491e5c69-e75f-42d5-9aac-054573135099 req-84f1e4c7-a62a-4977-abbd-97482d542fb1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.544822 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-491e5c69-e75f-42d5-9aac-054573135099 req-84f1e4c7-a62a-4977-abbd-97482d542fb1 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:40.556321 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-491e5c69-e75f-42d5-9aac-054573135099 req-84f1e4c7-a62a-4977-abbd-97482d542fb1 service nova] Creating event network-vif-plugged:2e77a9a5-aa49-46ee-9315-297c9ed8b731 for instance e638b92a-b36c-4982-b060-183eac639a1b on hv-cinder-81242 Jul 28 06:38:40.561345 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-491e5c69-e75f-42d5-9aac-054573135099 req-84f1e4c7-a62a-4977-abbd-97482d542fb1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030957 Jul 28 06:38:40.568229 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 581/1169] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:38:40.867978 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:40.870340 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:40.875928 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.876469 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:40.878463 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:40.878904 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:41.038522 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:41.046444 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3fd28efd-224e-4c39-b255-3a8210a078f6 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.182222 Jul 28 06:38:41.047766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 589/1170] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:40 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:42.069033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:42.069765 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:42.076080 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:42.076529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:42.077322 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:42.077763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:42.211434 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:42.218952 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-2e9655d9-f6f7-4933-95c3-bde77b520e67 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1260 microversion: 2.1 time: 0.155399 Jul 28 06:38:42.219552 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 582/1171] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:42 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:43.240325 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:43.240933 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:43.247483 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:43.247931 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:43.248695 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:43.249134 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:43.386650 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:43.395537 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-bbd6b205-43f7-49c7-a5b8-fb7c760516ca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1444 microversion: 2.1 time: 0.159031 Jul 28 06:38:43.396119 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 590/1172] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:43 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:43.416388 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:38:43.417009 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:38:43.423540 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:43.423995 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:43.425472 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:43.425812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:43.558691 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:38:43.566360 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-a15a4594-673c-42ce-8b24-fd8ae6e4d6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1444 microversion: 2.1 time: 0.153798 Jul 28 06:38:43.566931 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 583/1173] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:38:43 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:38:45.783552 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-a85bbe53-817f-41b6-b596-cc220683c351 req-6baa3256-ee00-4774-b481-dee9ec6aecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:38:45.793622 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-a85bbe53-817f-41b6-b596-cc220683c351 req-6baa3256-ee00-4774-b481-dee9ec6aecd9 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:38:45.794070 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-a85bbe53-817f-41b6-b596-cc220683c351 req-6baa3256-ee00-4774-b481-dee9ec6aecd9 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:38:45.808075 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-a85bbe53-817f-41b6-b596-cc220683c351 req-6baa3256-ee00-4774-b481-dee9ec6aecd9 service nova] Creating event network-changed:2e77a9a5-aa49-46ee-9315-297c9ed8b731 for instance e638b92a-b36c-4982-b060-183eac639a1b on hv-cinder-81242 Jul 28 06:38:45.813353 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-a85bbe53-817f-41b6-b596-cc220683c351 req-6baa3256-ee00-4774-b481-dee9ec6aecd9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033435 Jul 28 06:38:45.813951 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 591/1174] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:39.391149 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:39.393641 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=58 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:39.399219 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:39.399866 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:39.403725 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=28 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:39.404495 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=52 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:39:39.408882 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.410082 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.410829 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.411273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.442093 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:39:39.476587 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-7b6f7ae4-663e-4212-99c0-9727621f0ffc req-b91ceb7d-4d9a-4b04-919a-6b4306bf4ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb42f64-42df-4d6f-85c7-67cca4f6492b", "tag": "6ebf1019-d3cf-46bd-8c5b-46f7f329eccb"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:39.487176 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-7b6f7ae4-663e-4212-99c0-9727621f0ffc req-b91ceb7d-4d9a-4b04-919a-6b4306bf4ed6 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.487612 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-7b6f7ae4-663e-4212-99c0-9727621f0ffc req-b91ceb7d-4d9a-4b04-919a-6b4306bf4ed6 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.500035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-7b6f7ae4-663e-4212-99c0-9727621f0ffc req-b91ceb7d-4d9a-4b04-919a-6b4306bf4ed6 service nova] Creating event network-changed:6ebf1019-d3cf-46bd-8c5b-46f7f329eccb for instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b on hv-cinder-81242 Jul 28 06:39:39.505410 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-7b6f7ae4-663e-4212-99c0-9727621f0ffc req-b91ceb7d-4d9a-4b04-919a-6b4306bf4ed6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115846 Jul 28 06:39:39.506095 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 592/1175] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:39.752220 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-14773eee-0ac9-4447-8ecf-f957ba92839f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 204 len: 0 microversion: 2.1 time: 0.366004 Jul 28 06:39:39.755593 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 584/1176] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:39:39 2022] DELETE /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:39:39.764038 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:39.764909 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:39.773025 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.774466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.774466 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:39.774962 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:39.912527 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:39.920214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ff25ba46-e766-431d-99b3-9bc246ed6369 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1576 microversion: 2.1 time: 0.162227 Jul 28 06:39:39.920793 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 593/1177] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:39 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:40.942251 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:40.943094 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:40.949874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.950326 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:40.951099 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:40.951529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.104376 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:41.112922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-49fa05ec-5a65-47b2-9b40-204f58a02c01 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1576 microversion: 2.1 time: 0.175115 Jul 28 06:39:41.113516 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 585/1178] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:40 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:41.828515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-1cd1dbb3-2393-4d4f-914c-73888b68bc18 req-af09d457-f82b-41d3-9425-9420a1aa9ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb42f64-42df-4d6f-85c7-67cca4f6492b", "name": "network-vif-deleted", "tag": "6ebf1019-d3cf-46bd-8c5b-46f7f329eccb"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:41.839607 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-1cd1dbb3-2393-4d4f-914c-73888b68bc18 req-af09d457-f82b-41d3-9425-9420a1aa9ac8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:41.843268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-1cd1dbb3-2393-4d4f-914c-73888b68bc18 req-af09d457-f82b-41d3-9425-9420a1aa9ac8 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:41.852101 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-1cd1dbb3-2393-4d4f-914c-73888b68bc18 req-af09d457-f82b-41d3-9425-9420a1aa9ac8 service nova] Creating event network-vif-deleted:6ebf1019-d3cf-46bd-8c5b-46f7f329eccb for instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b on hv-cinder-81242 Jul 28 06:39:41.858441 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-1cd1dbb3-2393-4d4f-914c-73888b68bc18 req-af09d457-f82b-41d3-9425-9420a1aa9ac8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034544 Jul 28 06:39:41.859640 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 594/1179] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:42.135440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:42.136061 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:42.143648 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.144107 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.144890 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:42.145425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:42.211747 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:42.220527 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-d6157322-4a65-4ee6-981a-879cc7328b44 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 200 len: 1225 microversion: 2.1 time: 0.088892 Jul 28 06:39:42.221105 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 586/1180] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:42 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:43.243080 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:43.243768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: 4cb42f64-42df-4d6f-85c7-67cca4f6492b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:43.250088 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.250532 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.251285 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:43.251725 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:43.264744 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] HTTP exception thrown: Instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b could not be found. Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Request method failure captured: Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b HTTP/1.1 Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i07fMkJn2JQRQirCm3NfKSmq2P6_roWok4CVt3BSqSF5piAaE9gjVbXoswnlHv3fz9DC4GSd6kb7TreISWD9CAv2O9RrDLLIckcjP9Xor79kTXozdmUZryxjhYUCmcn6RCC96PJ-u4kjLkftfkGN5xLAnvMI5MmMEDCK7QxfiyBM5U Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:39:43.266485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47b406d9a12c461a84aa0331d2890990", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}] Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: b1868c7d0ec8443b9ccb698ee02928b6 Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b could not be found. Jul 28 06:39:43.268214 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': '4cb42f64-42df-4d6f-85c7-67cca4f6492b'} Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b could not be found. Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:39:43.269162 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b could not be found. Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b could not be found. Jul 28 06:39:43.270887 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:43.272295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Returning 404 to user: Instance 4cb42f64-42df-4d6f-85c7-67cca4f6492b could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:39:43.272295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-a00ce7b6-120c-4f24-994a-b64aaf786460 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b" status: 404 len: 111 microversion: 2.1 time: 0.029544 Jul 28 06:39:43.272295 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 595/1181] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:43 2022] GET /compute/v2.1/servers/4cb42f64-42df-4d6f-85c7-67cca4f6492b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:39:46.530212 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:46.531379 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:46.532669 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-c6554ecc-2ee4-419f-ad26-64b2edca1664 req-2885bc7a-81c3-4778-86c9-1cf9f1830a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea", "tag": "3fbc8176-5d92-4b04-9641-3e29219cebce"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:46.538284 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.538819 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.539692 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.540187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.543257 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c6554ecc-2ee4-419f-ad26-64b2edca1664 req-2885bc7a-81c3-4778-86c9-1cf9f1830a69 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.543893 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-c6554ecc-2ee4-419f-ad26-64b2edca1664 req-2885bc7a-81c3-4778-86c9-1cf9f1830a69 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.555703 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-c6554ecc-2ee4-419f-ad26-64b2edca1664 req-2885bc7a-81c3-4778-86c9-1cf9f1830a69 service nova] Creating event network-changed:3fbc8176-5d92-4b04-9641-3e29219cebce for instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea on hv-cinder-81242 Jul 28 06:39:46.561967 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-c6554ecc-2ee4-419f-ad26-64b2edca1664 req-2885bc7a-81c3-4778-86c9-1cf9f1830a69 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032769 Jul 28 06:39:46.563641 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 596/1182] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 06:39:46.569626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:39:46.861000 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-84f1cfe5-f250-4f07-b2a7-f7e574c96f25 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 204 len: 0 microversion: 2.1 time: 0.334710 Jul 28 06:39:46.861897 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 587/1183] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:39:46 2022] DELETE /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 06:39:46.871613 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:46.873163 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:46.879806 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.880259 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:46.881274 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:46.882136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:47.028232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:47.036680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cefb3a2a-20b4-4af7-aa79-af730bf90e16 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1577 microversion: 2.1 time: 0.169891 Jul 28 06:39:47.037269 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 597/1184] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:46 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:48.059311 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:48.060938 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:48.067977 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.068432 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.069359 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.069805 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.299371 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:48.307136 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-acda9586-43ae-493c-be08-bdbe7221526f tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1577 microversion: 2.1 time: 0.252293 Jul 28 06:39:48.307728 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 588/1185] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:48 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:39:48.902543 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-f36f7e7b-9252-4087-a309-a2ab6532c59f req-503b4d68-73e6-4794-b94f-ac194964d308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea", "name": "network-vif-deleted", "tag": "3fbc8176-5d92-4b04-9641-3e29219cebce"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:39:48.912514 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-f36f7e7b-9252-4087-a309-a2ab6532c59f req-503b4d68-73e6-4794-b94f-ac194964d308 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:48.912952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-f36f7e7b-9252-4087-a309-a2ab6532c59f req-503b4d68-73e6-4794-b94f-ac194964d308 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:48.924840 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-f36f7e7b-9252-4087-a309-a2ab6532c59f req-503b4d68-73e6-4794-b94f-ac194964d308 service nova] Creating event network-vif-deleted:3fbc8176-5d92-4b04-9641-3e29219cebce for instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea on hv-cinder-81242 Jul 28 06:39:48.929825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-f36f7e7b-9252-4087-a309-a2ab6532c59f req-503b4d68-73e6-4794-b94f-ac194964d308 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030969 Jul 28 06:39:48.930417 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 598/1186] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:39:49.329542 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:49.330273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:49.338503 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.339085 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.340026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:49.340693 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:49.410996 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1868c7d0ec8443b9ccb698ee02928b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b406d9a12c461a84aa0331d2890990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:39:49.418661 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-62146af9-e51d-4d94-81a1-6ad7a303feb1 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 200 len: 1225 microversion: 2.1 time: 0.093739 Jul 28 06:39:49.419753 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 589/1187] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:49 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:39:50.441110 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.441862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.448088 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.448536 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.449298 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.449764 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.465600 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] HTTP exception thrown: Instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea could not be found. Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Request method failure captured: Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea HTTP/1.1 Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i07fMkJn2JQRQirCm3NfKSmq2P6_roWok4CVt3BSqSF5piAaE9gjVbXoswnlHv3fz9DC4GSd6kb7TreISWD9CAv2O9RrDLLIckcjP9Xor79kTXozdmUZryxjhYUCmcn6RCC96PJ-u4kjLkftfkGN5xLAnvMI5MmMEDCK7QxfiyBM5U Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:39:50.467911 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47b406d9a12c461a84aa0331d2890990", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}] Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: b1868c7d0ec8443b9ccb698ee02928b6 Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea could not be found. Jul 28 06:39:50.469588 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea'} Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea could not be found. Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:39:50.470596 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea could not be found. Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea could not be found. Jul 28 06:39:50.472186 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:50.473625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Returning 404 to user: Instance f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:39:50.473625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-0d94ad31-6c37-44cd-83b2-37617dc3bb70 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea" status: 404 len: 111 microversion: 2.1 time: 0.032994 Jul 28 06:39:50.473625 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 599/1188] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:50 2022] GET /compute/v2.1/servers/f2e8a38b-e93f-4c91-9b64-ed4ab1ec47ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:39:50.988209 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:50.988711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:50.995314 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.995760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:50.996529 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:50.996959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.011003 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.wsgi [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] HTTP exception thrown: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Request method failure captured: Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: request: DELETE /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 HTTP/1.1 Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept: application/json Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Accept-Encoding: identity Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Connection: close Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Length: 0 Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Content-Type: application/json Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Host: 10.222.0.69 Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Openstack-System-Scope: None Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: User-Agent: python-urllib3/1.26.10 Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Auth-Token: gAAAAABi4i07fMkJn2JQRQirCm3NfKSmq2P6_roWok4CVt3BSqSF5piAaE9gjVbXoswnlHv3fz9DC4GSd6kb7TreISWD9CAv2O9RrDLLIckcjP9Xor79kTXozdmUZryxjhYUCmcn6RCC96PJ-u4kjLkftfkGN5xLAnvMI5MmMEDCK7QxfiyBM5U Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Id: None Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Domain-Name: None Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Identity-Status: Confirmed Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Is-Admin-Project: True Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Id: default Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Domain-Name: Default Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Project-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Role: reader,member Jul 28 06:39:51.012689 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Roles: reader,member Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47b406d9a12c461a84aa0331d2890990", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}] Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-Tenant-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Id: default Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Domain-Name: Default Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Id: b1868c7d0ec8443b9ccb698ee02928b6 Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: X-User-Name: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: method: > Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: exception: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.016114 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: action_args: {'id': 'da8c072e-b6c3-486f-9755-c32b99e783f7'} Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:39:51.017095 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.018812 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.020496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Returning 404 to user: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. {{(pid=118387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:39:51.020496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-01eaae54-7345-4b5d-b5b7-4e9bda572fe4 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "DELETE /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 404 len: 111 microversion: 2.1 time: 0.030070 Jul 28 06:39:51.020496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 590/1189] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:39:50 2022] DELETE /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 06:39:51.023715 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:51.024318 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] [instance: da8c072e-b6c3-486f-9755-c32b99e783f7] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:39:51.030486 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.030927 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.031673 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:39:51.032101 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:39:51.045252 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] HTTP exception thrown: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Request method failure captured: Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 HTTP/1.1 Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i07fMkJn2JQRQirCm3NfKSmq2P6_roWok4CVt3BSqSF5piAaE9gjVbXoswnlHv3fz9DC4GSd6kb7TreISWD9CAv2O9RrDLLIckcjP9Xor79kTXozdmUZryxjhYUCmcn6RCC96PJ-u4kjLkftfkGN5xLAnvMI5MmMEDCK7QxfiyBM5U Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:39:51.047310 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_47b406d9a12c461a84aa0331d2890990", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/47b406d9a12c461a84aa0331d2890990"}]}] Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 47b406d9a12c461a84aa0331d2890990 Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-TestVolumeBootPattern-889618680 Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: b1868c7d0ec8443b9ccb698ee02928b6 Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-TestVolumeBootPattern-889618680-project Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.049130 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'da8c072e-b6c3-486f-9755-c32b99e783f7'} Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:39:51.050141 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. Jul 28 06:39:51.051745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:39:51.053175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Returning 404 to user: Instance da8c072e-b6c3-486f-9755-c32b99e783f7 could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:39:51.053175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-91eedb70-ace6-4bcc-8d53-4176da68034c tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7" status: 404 len: 111 microversion: 2.1 time: 0.028745 Jul 28 06:39:51.053175 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 600/1190] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:39:51 2022] GET /compute/v2.1/servers/da8c072e-b6c3-486f-9755-c32b99e783f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:39:52.659628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-ac05b086-7f68-401b-8aa0-11e7cec6d4e7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] Calling method '.version_select at 0x7fbe6276f940>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:39:52.736686 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-ac05b086-7f68-401b-8aa0-11e7cec6d4e7 tempest-TestVolumeBootPattern-889618680 tempest-TestVolumeBootPattern-889618680-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-251647084" status: 202 len: 0 microversion: 2.1 time: 0.080976 Jul 28 06:39:52.737270 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 591/1191] 10.222.0.69 () {58 vars in 1260 bytes} [Thu Jul 28 06:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-251647084 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:40:41.070829 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:41.071438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:41.073479 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=18 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:41.074113 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=26 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:41.079871 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.084872 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.084872 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.084872 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.105534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.objects.instance [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lazy-loading 'flavor' on Instance uuid e638b92a-b36c-4982-b060-183eac639a1b {{(pid=118388) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 06:40:41.418817 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-9f688c54-26dc-40e7-947e-979fe31c56b1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "POST /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b/action" status: 202 len: 0 microversion: 2.1 time: 0.351991 Jul 28 06:40:41.420195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 601/1192] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:40:41 2022] POST /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:40:41.425473 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:41.426239 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:40:41.430400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:41.431018 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:41.438279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.438763 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.439536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:41.439976 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:41.575213 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:41.584043 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-53b2d19a-4ee4-4b19-9b60-22d6a8237069 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.160169 Jul 28 06:40:41.584618 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 592/1193] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:41 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:42.606747 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:42.607448 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:42.614356 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.614835 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.615601 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:42.616087 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:42.752195 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:42.759751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4709f4ed-fa50-446c-8228-4eff472d0b26 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.157403 Jul 28 06:40:42.760319 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 602/1194] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:42 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:43.782016 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:43.782628 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:43.790307 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:43.790759 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:43.791530 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:43.791971 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:43.927626 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:43.935110 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-5b7bd0dd-6cb5-4d99-ad6c-48bdd9deb4d7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.157977 Jul 28 06:40:43.935696 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 593/1195] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:43 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:44.957450 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:44.958066 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:44.964566 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.965016 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:44.965805 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:44.966242 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:45.103022 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:45.110813 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-81189846-1e86-4ee2-b75b-1955c9d567cb tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.157246 Jul 28 06:40:45.111384 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 603/1196] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:44 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:46.131858 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:46.132471 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:46.138959 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:46.140201 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.141241 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:46.141711 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:46.271750 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:46.279413 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-db90445e-f0d7-4af7-afb1-5fced305727d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.151416 Jul 28 06:40:46.280066 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 594/1197] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:46 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:47.300962 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:47.301628 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:47.308475 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.308912 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.309718 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:47.310313 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:47.446438 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:47.455536 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-e1a332ec-96e3-4eaa-99fd-fc502e499c9a tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.158623 Jul 28 06:40:47.456110 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 604/1198] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:47 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:48.477416 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:48.478042 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:48.485195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.485671 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.486443 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:48.486886 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:48.625328 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:48.632874 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-4d451a13-bcda-4244-a375-6dfa4c8e1882 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.159364 Jul 28 06:40:48.633468 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 595/1199] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:48 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:49.654594 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:49.655843 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:49.662348 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.662800 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.663561 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:49.663999 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:49.796153 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:49.803945 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-cd66ea59-00be-44f0-a855-6e194da9d1fc tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.153151 Jul 28 06:40:49.804522 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 605/1200] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:49 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:50.826279 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:50.826895 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:50.833480 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.833937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.834760 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:50.835209 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:50.973534 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:50.981011 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-e139dc53-c13b-4267-8745-5064bcd69510 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.158913 Jul 28 06:40:50.981615 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 596/1201] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:50 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:52.003608 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:52.004583 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:52.017188 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.017973 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.018768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:52.019206 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:52.234529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:52.246250 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-864cf705-13ac-44c8-a8d6-e0ed21380273 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.247657 Jul 28 06:40:52.246834 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 606/1202] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:51 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:53.268575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:53.269180 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:53.275886 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:53.276342 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.277111 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:53.277582 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:53.419060 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:53.426945 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-58106be1-3c82-44d9-85bc-fa845e12fc8f tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.162786 Jul 28 06:40:53.427518 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 597/1203] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:53 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:54.448132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:54.448781 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:54.456071 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.456559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.457347 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:54.457789 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:54.596560 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:54.604459 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-df4b2721-b28c-4952-bd75-f0585d6afda4 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.160073 Jul 28 06:40:54.605039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 607/1204] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:54 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:40:55.627004 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:55.627627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:55.634867 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.635312 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.636081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.636519 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.772799 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:55.780364 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-7325ce6f-6fe5-478d-9895-60e09282a7a8 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1510 microversion: 2.1 time: 0.158115 Jul 28 06:40:55.781001 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 598/1205] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:55 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:55.801300 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:55.801937 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:55.808346 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.808785 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.809592 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:55.810019 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:55.838661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118388) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 06:40:56.129862 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-4580f570-c788-4a98-92c8-3c2d5e1acc03 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "POST /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b/action" status: 202 len: 0 microversion: 2.1 time: 0.332327 Jul 28 06:40:56.130477 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 608/1206] 10.222.0.69 () {60 vars in 1278 bytes} [Thu Jul 28 06:40:55 2022] POST /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:40:56.138749 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:56.139400 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:56.146673 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:56.147126 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:56.148075 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:56.148483 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:56.282634 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:56.290319 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-51d2a206-ba70-477c-8d24-14b13c62f1c1 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1518 microversion: 2.1 time: 0.155657 Jul 28 06:40:56.290901 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 599/1207] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:56 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:57.030525 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-1adcd2d4-d642-4d75-b082-f033a23f4adc req-e8357561-a349-4116-a3e7-3e79613c3c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "name": "network-vif-unplugged", "status": "completed", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:40:57.044969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-1adcd2d4-d642-4d75-b082-f033a23f4adc req-e8357561-a349-4116-a3e7-3e79613c3c95 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.044969 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-1adcd2d4-d642-4d75-b082-f033a23f4adc req-e8357561-a349-4116-a3e7-3e79613c3c95 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.055478 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.compute.server_external_events [req-1adcd2d4-d642-4d75-b082-f033a23f4adc req-e8357561-a349-4116-a3e7-3e79613c3c95 service nova] Unable to find a host for instance e638b92a-b36c-4982-b060-183eac639a1b. Dropping event network-vif-unplugged {{(pid=118388) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 06:40:57.057529 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-1adcd2d4-d642-4d75-b082-f033a23f4adc req-e8357561-a349-4116-a3e7-3e79613c3c95 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.090097 Jul 28 06:40:57.058352 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 609/1208] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 06:40:57.311762 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:57.313232 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:57.319873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.322643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.322643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:57.322643 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:57.467081 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:57.474993 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-9a6f1593-db06-40de-9062-450ae1290c08 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1520 microversion: 2.1 time: 0.167076 Jul 28 06:40:57.475575 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 600/1209] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:57 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:58.496576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:58.497192 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:58.504711 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:58.505171 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:58.506161 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:58.506604 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:58.645029 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:58.652617 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-42d68ae4-c725-4ba1-a743-159249a4cfca tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1520 microversion: 2.1 time: 0.160338 Jul 28 06:40:58.655073 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 610/1210] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:58 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:40:59.674838 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:40:59.675453 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:40:59.681984 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:59.682440 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:59.683206 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:40:59.683649 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:40:59.818999 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:40:59.826937 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-daf175f5-4c82-408b-95a1-1114cbb0b6b3 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.157037 Jul 28 06:40:59.827515 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 601/1211] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:40:59 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:00.849232 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:00.849941 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:00.856680 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:00.857122 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.857922 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:00.858351 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:00.990661 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:00.998204 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-c92a3d1d-5ddc-4b9b-aca0-d3f55ae15bd7 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.152931 Jul 28 06:41:00.998768 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 611/1212] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:00 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:02.019530 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:02.020156 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:02.026783 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:02.027409 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:02.028154 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:02.028595 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:02.163314 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:02.170847 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0b80e163-7670-4132-b633-24f04122b7e0 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.155613 Jul 28 06:41:02.171418 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 602/1213] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:02 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:03.192733 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:03.193388 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:03.200247 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:03.200702 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:03.201497 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:03.201940 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:03.335039 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:03.342730 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-f787dd6a-650a-4a16-830c-7615d3c2fc64 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.153843 Jul 28 06:41:03.343299 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 612/1214] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:03 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:04.364046 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:04.364666 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:04.371378 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.371821 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.372611 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:04.373029 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:04.505450 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:04.512934 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-be4f550e-fe95-462e-941c-6f60fac9d1ac tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.152735 Jul 28 06:41:04.513535 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 603/1215] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:04 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:05.536399 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:05.537035 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:05.543602 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:05.544051 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:05.544812 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:05.545248 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:05.687842 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:05.693576 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-45861023-beac-47e1-8af3-f458cf39e7e5 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.160981 Jul 28 06:41:05.694144 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 613/1216] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:05 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:41:06.714898 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:06.715467 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:06.722633 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:06.723247 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.723988 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:06.724427 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:06.861709 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:06.869195 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-8762ab0d-7a0b-471d-8584-02a0e8d1c565 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.158236 Jul 28 06:41:06.869766 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 604/1217] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:06 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:07.890129 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:07.890745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:07.897548 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.898091 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:07.898881 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:07.899301 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:08.038516 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:08.046127 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ba0fa6a5-e96d-4806-be15-b451471f65ef tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.159852 Jul 28 06:41:08.046672 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 614/1218] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:07 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:09.064855 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [req-ce8920bd-d2ae-460c-b56c-5bb2d7368ff5 req-bf85e4e3-5889-43dd-b444-31ddb9890c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "name": "network-vif-plugged", "status": "completed", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:41:09.067766 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:09.068446 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:09.075334 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.075773 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ce8920bd-d2ae-460c-b56c-5bb2d7368ff5 req-bf85e4e3-5889-43dd-b444-31ddb9890c41 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.076006 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.076218 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [req-ce8920bd-d2ae-460c-b56c-5bb2d7368ff5 req-bf85e4e3-5889-43dd-b444-31ddb9890c41 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.076534 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:09.076971 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:09.083056 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:09.088468 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.compute.server_external_events [req-ce8920bd-d2ae-460c-b56c-5bb2d7368ff5 req-bf85e4e3-5889-43dd-b444-31ddb9890c41 service nova] Creating event network-vif-plugged:2e77a9a5-aa49-46ee-9315-297c9ed8b731 for instance e638b92a-b36c-4982-b060-183eac639a1b on hv-cinder-81242 Jul 28 06:41:09.093873 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [req-ce8920bd-d2ae-460c-b56c-5bb2d7368ff5 req-bf85e4e3-5889-43dd-b444-31ddb9890c41 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 Jul 28 06:41:09.095546 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 605/1219] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:41:09.222086 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:09.229811 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-99110ea9-a017-4a54-af91-66b7e9e78a10 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.165936 Jul 28 06:41:09.230395 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 615/1220] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:09 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 06:41:10.251587 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:10.252285 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:10.258975 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:10.259425 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:10.260191 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:10.260627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:10.394256 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:10.402134 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-0458c751-4cd0-4d4b-b276-cecf93026fbe tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1576 microversion: 2.1 time: 0.154750 Jul 28 06:41:10.402723 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 606/1221] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:10 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:41:11.424838 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:41:11.425415 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:41:11.427700 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:41:11.432745 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:11.440077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:11.440077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:41:11.440077 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:41:11.566357 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:41:11.573638 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-957cd301-f49a-4ed0-9091-fd7333dc7a0d tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1563 microversion: 2.1 time: 0.153660 Jul 28 06:41:11.574202 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 616/1222] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:41:11 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:22.219257 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_api:SELECT=30 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:22.221187 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG dbcounter [-] [118387] Writing DB stats nova_cell1:SELECT=86 {{(pid=118387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:22.224515 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG dbcounter [-] [118388] Writing DB stats nova_api:SELECT=1 {{(pid=118388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 06:42:22.229888 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:22.230389 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:22.236610 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.238424 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.239915 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.240366 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.268495 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Going to try to terminate instance {{(pid=118387) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 06:42:22.294358 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-bc9502db-7a31-4ee1-9131-e672000059d3 req-d76b723b-9a46-4a3f-a0c3-962ef120b146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:22.311906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-bc9502db-7a31-4ee1-9131-e672000059d3 req-d76b723b-9a46-4a3f-a0c3-962ef120b146 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.311906 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-bc9502db-7a31-4ee1-9131-e672000059d3 req-d76b723b-9a46-4a3f-a0c3-962ef120b146 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.317541 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-bc9502db-7a31-4ee1-9131-e672000059d3 req-d76b723b-9a46-4a3f-a0c3-962ef120b146 service nova] Creating event network-changed:2e77a9a5-aa49-46ee-9315-297c9ed8b731 for instance e638b92a-b36c-4982-b060-183eac639a1b on hv-cinder-81242 Jul 28 06:42:22.323311 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-bc9502db-7a31-4ee1-9131-e672000059d3 req-d76b723b-9a46-4a3f-a0c3-962ef120b146 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100271 Jul 28 06:42:22.323939 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 617/1223] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:22.577356 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-bd6d6186-b4d0-4977-a7eb-98486f64d712 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 204 len: 0 microversion: 2.1 time: 0.359743 Jul 28 06:42:22.577880 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 607/1224] 10.222.0.69 () {58 vars in 1239 bytes} [Thu Jul 28 06:42:22 2022] DELETE /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 06:42:22.587751 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:22.589895 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:22.595485 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.596012 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.596859 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:22.597445 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:22.732559 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.policy [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118388) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:22.742501 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-3a3e4514-bf96-4b31-9be0-f0a23a7ad925 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.159341 Jul 28 06:42:22.743123 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 618/1225] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:22 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:23.765841 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:23.766549 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:23.774568 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:23.775027 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:23.775798 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:23.776228 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:23.936496 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:23.944922 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-fc7669bf-33ac-40b7-9f0f-b34f41912df2 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1569 microversion: 2.1 time: 0.183394 Jul 28 06:42:23.945532 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 608/1226] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:23 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:24.637340 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [req-5c42d891-9649-468a-b8ae-b2c859924ee6 req-f7ba1048-f7d9-479b-9b9f-fdb5720efbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e638b92a-b36c-4982-b060-183eac639a1b", "name": "network-vif-deleted", "tag": "2e77a9a5-aa49-46ee-9315-297c9ed8b731"}]} {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 06:42:24.648743 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-5c42d891-9649-468a-b8ae-b2c859924ee6 req-f7ba1048-f7d9-479b-9b9f-fdb5720efbd7 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:24.649187 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [req-5c42d891-9649-468a-b8ae-b2c859924ee6 req-f7ba1048-f7d9-479b-9b9f-fdb5720efbd7 service nova] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:24.659956 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.compute.server_external_events [req-5c42d891-9649-468a-b8ae-b2c859924ee6 req-f7ba1048-f7d9-479b-9b9f-fdb5720efbd7 service nova] Creating event network-vif-deleted:2e77a9a5-aa49-46ee-9315-297c9ed8b731 for instance e638b92a-b36c-4982-b060-183eac639a1b on hv-cinder-81242 Jul 28 06:42:24.665787 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [req-5c42d891-9649-468a-b8ae-b2c859924ee6 req-f7ba1048-f7d9-479b-9b9f-fdb5720efbd7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032065 Jul 28 06:42:24.666511 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 619/1227] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 28 06:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 06:42:24.973588 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:24.974403 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.compute.api [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118387) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:24.981627 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:24.986273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:24.986273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:24.986273 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG oslo_concurrency.lockutils [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:25.048997 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.policy [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a22e1003d74332ba4f0ee84b6422e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce97bbb75d4412e90231e4da14840bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118387) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 06:42:25.057694 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-312d0b6c-a44f-43b7-a3bd-f1b0bec8fd46 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 200 len: 1219 microversion: 2.1 time: 0.088060 Jul 28 06:42:25.058265 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 609/1228] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:24 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 06:42:26.079251 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '>' {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:26.080000 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.compute.api [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] [instance: e638b92a-b36c-4982-b060-183eac639a1b] Fetching instance by UUID {{(pid=118388) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 06:42:26.087136 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:26.087586 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:26.088363 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 06:42:26.088952 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG oslo_concurrency.lockutils [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Lock "b0a3eae9-0d22-4f3c-bccf-cc68873f0cfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118388) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 06:42:26.107935 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.wsgi [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] HTTP exception thrown: Instance e638b92a-b36c-4982-b060-183eac639a1b could not be found. Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Request method failure captured: Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: request: GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b HTTP/1.1 Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept: application/json Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Accept-Encoding: identity Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Connection: close Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Length: 0 Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Content-Type: application/json Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Host: 10.222.0.69 Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Openstack-System-Scope: None Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: User-Agent: python-urllib3/1.26.10 Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Auth-Token: gAAAAABi4i7CDcoX7yCGb_G9YKp-cYRF6TnecnuNE4p50OZ4_-htDjK0d82MQbFBA_Et02ZIAwVJgSWtsw6q6VXFWo-fN5N2Zcxj7Qu4kcEL7ejnQ8Sp5Uij0SNJ0gik8UK2rJCFoY6nfyzJWx90dPRDSO_efMtQo0gbQinQoX1OWkTsNg42K7E Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Id: None Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Domain-Name: None Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Identity-Status: Confirmed Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Is-Admin-Project: True Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Id: default Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Domain-Name: Default Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Id: 3ce97bbb75d4412e90231e4da14840bc Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Project-Name: tempest-TestShelveInstance-1633679530 Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Role: reader,member Jul 28 06:42:26.110132 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Roles: reader,member Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3ce97bbb75d4412e90231e4da14840bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3ce97bbb75d4412e90231e4da14840bc", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3ce97bbb75d4412e90231e4da14840bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3ce97bbb75d4412e90231e4da14840bc"}]}] Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant: tempest-TestShelveInstance-1633679530 Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Id: 3ce97bbb75d4412e90231e4da14840bc Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-Tenant-Name: tempest-TestShelveInstance-1633679530 Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User: tempest-TestShelveInstance-1633679530-project Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Id: default Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Domain-Name: Default Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Id: 95a22e1003d74332ba4f0ee84b6422e4 Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: X-User-Name: tempest-TestShelveInstance-1633679530-project Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: method: > Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: exception: Instance e638b92a-b36c-4982-b060-183eac639a1b could not be found. Jul 28 06:42:26.111994 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: action_args: {'id': 'e638b92a-b36c-4982-b060-183eac639a1b'} Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: {{(pid=118388) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e638b92a-b36c-4982-b060-183eac639a1b could not be found. Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 06:42:26.115059 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e638b92a-b36c-4982-b060-183eac639a1b could not be found. Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e638b92a-b36c-4982-b060-183eac639a1b could not be found. Jul 28 06:42:26.116791 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: ERROR nova.api.openstack.wsgi Jul 28 06:42:26.118329 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: DEBUG nova.api.openstack.wsgi [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Returning 404 to user: Instance e638b92a-b36c-4982-b060-183eac639a1b could not be found. {{(pid=118388) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 06:42:26.118329 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO nova.api.openstack.requestlog [None req-ee005a12-9e75-42a9-a8dd-dc9de0ec6091 tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b" status: 404 len: 111 microversion: 2.1 time: 0.037009 Jul 28 06:42:26.118329 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: [pid: 118388|app: 0|req: 620/1229] 10.222.0.69 () {58 vars in 1236 bytes} [Thu Jul 28 06:42:26 2022] GET /compute/v2.1/servers/e638b92a-b36c-4982-b060-183eac639a1b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 06:42:26.345033 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: DEBUG nova.api.openstack.wsgi [None req-f96c8483-dcea-406e-b193-37c8a350188e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] Calling method '.version_select at 0x7fbe626058b0>' {{(pid=118387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 06:42:26.450022 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO nova.api.openstack.requestlog [None req-f96c8483-dcea-406e-b193-37c8a350188e tempest-TestShelveInstance-1633679530 tempest-TestShelveInstance-1633679530-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-554219014" status: 202 len: 0 microversion: 2.1 time: 0.108719 Jul 28 06:42:26.451536 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: [pid: 118387|app: 0|req: 610/1230] 10.222.0.69 () {58 vars in 1251 bytes} [Thu Jul 28 06:42:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-554219014 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 06:43:21.284923 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:43:21.285659 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Thu Jul 28 06:43:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:43:26.411888 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:43:26.412554 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Thu Jul 28 06:43:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:43:29.713098 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:43:29.713551 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Thu Jul 28 06:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:45:20.506825 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:45:20.507468 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Thu Jul 28 06:45:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:45:25.292962 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:45:25.293607 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Thu Jul 28 06:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:45:33.588258 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:45:33.588919 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Thu Jul 28 06:45:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:46:41.294017 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:46:41.294651 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Thu Jul 28 06:46:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:46:46.420268 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:46:46.421096 dv-cinder-812429-2-iscsi devstack@n-api.service[118388]: Thu Jul 28 06:46:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 06:46:49.721449 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 06:46:49.722026 dv-cinder-812429-2-iscsi devstack@n-api.service[118387]: Thu Jul 28 06:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!